-- Logs begin at Tue 2022-07-19 19:49:48 UTC, end at Tue 2022-07-19 21:25:52 UTC. -- Jul 19 20:44:57.056180 dv-cinder-749155-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 20:44:57 2022] *** Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: nodename: dv-cinder-749155-8-iscsi Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: machine: x86_64 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: clock source: unix Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: pcre jit disabled Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: detected number of CPU cores: 4 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: current working directory: / Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: detected binary path: /usr/bin/uwsgi-core Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: your processes number limit is 47680 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: your memory page size is 4096 bytes Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: detected max file descriptor number: 2048 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: lock engine: pthread robust mutexes Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: thunder lock: enabled Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 20:44:57.068372 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 20:44:57.116899 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: Python main interpreter initialized at 0x5585344bd9c0 Jul 19 20:44:57.116899 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: python threads support enabled Jul 19 20:44:57.116899 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: your server socket listen backlog is limited to 100 connections Jul 19 20:44:57.116899 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: your mercy for graceful operations on workers is 90 seconds Jul 19 20:44:57.117323 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 20:44:57.117323 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: *** Operational MODE: preforking *** Jul 19 20:44:57.117584 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: *** uWSGI is running in multiple interpreter mode *** Jul 19 20:44:57.117584 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: spawned uWSGI master process (pid: 109735) Jul 19 20:44:57.117864 dv-cinder-749155-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 20:44:57.119798 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: spawned uWSGI worker 1 (pid: 109736, cores: 1) Jul 19 20:44:57.119798 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: spawned uWSGI worker 2 (pid: 109737, cores: 1) Jul 19 20:44:57.119798 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 20:44:57.799109 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:44:57.801753 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:44:58.934924 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:44:58.934924 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: from cryptography.utils import int_from_bytes Jul 19 20:44:58.935683 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:44:58.935683 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: from cryptography.utils import int_from_bytes Jul 19 20:44:59.055196 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:44:59.055196 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: from cryptography.utils import int_from_bytes Jul 19 20:44:59.055802 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:44:59.055802 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: from cryptography.utils import int_from_bytes Jul 19 20:45:01.467603 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:45:01.468128 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:45:01.468303 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:45:01.468696 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:45:01.468953 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:45:01.469338 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.470891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.470891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.470891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.470891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.470891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.471495 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.471495 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.471822 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.472083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.472422 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.472751 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-8-iscsi {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.473073 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.473382 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.473693 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.474012 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.474322 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.474645 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.474951 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.475238 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:45:01.475760 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.475894 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:45:01.476015 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.476120 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:45:01.476230 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.476444 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:45:01.476572 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.476688 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:45:01.476850 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.477085 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.477219 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.477416 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.477561 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.477791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.477931 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.478048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.478157 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.478365 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.478490 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.478674 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.478824 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.479027 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.479226 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-8-iscsi {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.479406 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.479585 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.479795 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.479967 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.480113 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.480332 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.480529 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.480712 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.480908 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-8-iscsi {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.481099 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.481299 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.481489 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.481672 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.481827 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.482041 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.482234 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.482530 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.482687 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.482880 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483009 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483165 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483290 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483425 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483582 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483582 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483825 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.483965 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484095 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484261 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484428 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484537 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484659 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484779 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.484890 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485002 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485226 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485226 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485474 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485623 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485752 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485882 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.485997 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486111 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486226 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486386 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486510 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486635 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486822 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-8-iscsi {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.486956 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.487183 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.487318 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.487505 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.487640 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.487829 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.488045 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.488156 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.488359 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.488491 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.488658 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.488821 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489016 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489152 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489288 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489422 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489604 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489735 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.489909 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490045 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490229 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490364 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490546 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490678 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490866 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.490992 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.491169 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.491294 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.491491 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.491628 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.491806 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.491942 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.492120 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.492254 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.492451 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.492585 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.492779 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.492904 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493098 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493214 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493336 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493440 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493670 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493806 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.493997 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.494124 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.494319 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.494430 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.494628 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.494753 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.494878 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495000 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495132 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495256 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495456 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495584 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495782 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.495910 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.496083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.496206 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.496408 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.496536 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.496716 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.496854 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497024 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497148 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497328 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497459 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497634 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497767 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.497941 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.498650 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.498792 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.498925 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499175 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499347 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499482 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499654 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499779 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.499962 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.500097 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.500269 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.500435 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.500601 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.500765 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.500901 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.501023 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.501240 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.501395 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.501532 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.501708 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.501837 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502031 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502173 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502348 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502481 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502679 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502805 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.502989 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.503127 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.503294 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.503428 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.503617 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.503742 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.503921 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.504048 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.504226 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.504389 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.504579 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.504778 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.504907 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505038 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505163 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505284 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505447 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505574 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505764 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.505897 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506068 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506192 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506383 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506506 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506682 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506815 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.506988 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.507124 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.507292 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.507423 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.507596 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.507806 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.507957 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.508154 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.508472 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.508601 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.508831 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.508951 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509088 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509088 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509337 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509462 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509598 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509728 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509851 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.509972 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.510076 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.510232 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.510475 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.510600 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.510842 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.510982 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.511147 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.511271 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.511455 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.511588 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.511775 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.511912 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.512116 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.512248 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.512468 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.512607 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.512817 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.512947 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.513134 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.513266 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.513471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.513600 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.514402 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.514539 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.514717 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.514854 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.515036 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.515161 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.515355 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.515492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.515683 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.515816 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.515996 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.516121 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.516309 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.516544 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.516671 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.516802 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.516949 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.517103 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.517286 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.517470 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.517631 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.517805 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.517952 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.518072 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.518178 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.518288 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.518491 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.518605 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.518899 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.519021 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.519126 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.519236 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.519418 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.519538 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.519728 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.519866 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.520033 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.520159 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.520379 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.520510 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.520726 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.520926 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.521140 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.521326 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.521519 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.521696 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.521892 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.522067 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.522262 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.522491 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:45:01.522707 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.522892 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.523089 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.523269 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.523458 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.523648 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.523847 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524038 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524227 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524407 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524536 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524669 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524792 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.524915 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525042 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525164 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525286 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525418 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525543 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525672 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525796 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.525908 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526038 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526161 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526287 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526409 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526531 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526661 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526783 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.526917 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527046 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527170 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527298 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527443 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527566 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527752 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.527880 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.528058 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.528194 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.528390 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.528596 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.528787 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.528998 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.529335 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.529533 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.529720 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.529921 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.530116 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.530322 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.530515 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.530701 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.530904 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.531211 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.531405 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.531564 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.531679 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.531802 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.531934 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532065 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532196 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532196 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532458 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532584 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532715 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532838 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.532967 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533091 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533219 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533343 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533474 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533597 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533727 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533857 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.533986 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534108 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534242 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534373 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534497 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534627 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534749 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.534871 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535002 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535125 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535248 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535390 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535572 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535713 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.535887 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536011 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536204 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536440 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536605 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536751 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536877 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.536998 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.537128 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.537258 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.537467 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.537668 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.537862 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538049 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538233 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538374 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538497 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538631 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538756 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.538893 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.539024 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.539148 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.539296 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.539589 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.539784 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.539971 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.540150 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.540364 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.540563 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.540690 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.540830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.540954 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.541066 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.541187 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.541375 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.541565 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.541748 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.541949 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542096 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542218 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542348 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542470 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542590 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542696 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542825 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.542825 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543065 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543186 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543327 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543461 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543582 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543713 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.543835 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.544027 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.544175 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.544382 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.544567 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.544770 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.544989 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.545191 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.545345 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.545345 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.545576 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.545723 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.545846 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546005 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546182 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546381 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546581 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546770 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546917 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.546917 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547164 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547287 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547429 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547559 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547680 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547801 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.547921 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.548042 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.548172 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.548400 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.548530 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.548704 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.549016 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.549200 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.549335 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.549686 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.549814 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.549938 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550068 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550203 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550340 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550464 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550586 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550709 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550831 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.550962 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551086 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551199 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551353 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551510 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551653 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551819 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.551962 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.552135 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.552264 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.552469 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.552598 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.552782 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.552916 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.553093 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.553221 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.553413 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.553548 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.553731 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.553853 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.554040 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.554154 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.556859 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557038 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557172 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557298 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557414 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557522 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557627 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557759 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.557885 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.558277 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.558412 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.558539 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.558669 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.558802 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.558933 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559057 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559180 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559180 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559431 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559563 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559711 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.559931 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.560058 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.560187 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.560318 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.560457 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561090 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561212 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561323 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561442 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561649 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561776 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.561917 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562161 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562288 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562418 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562534 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562640 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562756 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562878 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.562999 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563128 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563250 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563378 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563507 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563629 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563759 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563759 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.563988 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564117 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564246 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564383 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564526 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564770 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.564891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565153 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565283 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565404 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565525 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565652 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565773 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.565895 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566024 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566146 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566267 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566372 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566476 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566588 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566705 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566810 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.566923 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567028 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567028 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567230 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567352 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567480 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567603 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567723 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567843 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.567972 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.568102 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.568231 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.568403 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.568581 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.568717 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.568924 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.569119 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.569314 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.569457 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.569580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.569718 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.569840 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570059 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570192 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570388 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570513 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570643 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570765 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.570886 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.571006 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.571128 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.571326 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.571464 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.571613 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.571738 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.572495 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.572627 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.572764 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.572899 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.573797 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.573963 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.574125 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.574959 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575115 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575239 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575239 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575523 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575635 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575747 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575862 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.575975 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.576080 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.576754 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.576876 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.576982 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577105 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577212 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577324 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577430 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577533 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577637 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577749 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577854 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.577965 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578079 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578190 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578278 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578357 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578446 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578527 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578605 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578730 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578862 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.578992 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579124 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579254 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579389 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579515 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579637 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579767 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.579891 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580036 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580250 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580392 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580517 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580655 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580778 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.580900 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581021 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581143 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581265 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581396 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581526 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581633 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581755 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.581883 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582006 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582137 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582261 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582386 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582517 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582641 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582775 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.582899 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583021 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583142 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583264 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583434 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583573 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583766 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.583893 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.584080 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.584207 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.584416 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.584562 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.584727 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.584865 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.585042 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.585168 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.585374 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.585509 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.585703 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.585946 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586073 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586280 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586488 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586613 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586735 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586858 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.586980 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.587167 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.587307 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.587469 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.587596 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.587779 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.587913 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.588088 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.588222 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.588422 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.588627 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.588772 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.588895 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589019 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589141 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589308 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589436 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589609 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589736 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.589923 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590049 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590292 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590441 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590567 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590690 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.590944 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.591204 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.591350 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.591518 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.591626 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.591754 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.591900 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592052 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592168 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592400 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592530 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592671 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592794 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.592977 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.593098 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.593282 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.593402 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.593584 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.593706 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.593893 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594007 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594203 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594316 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594508 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594629 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594825 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.594938 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.595132 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.595259 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.595444 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.595579 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.595748 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.595874 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596057 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596193 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596381 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596510 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596687 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596814 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.596996 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.597122 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.597318 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.597447 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.597634 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.597760 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.597963 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.598113 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.598272 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.598418 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601008 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601184 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601318 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601459 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601587 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601711 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601842 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.601967 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602090 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602205 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602311 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602434 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602557 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602691 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602815 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.602945 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603082 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603206 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603335 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603459 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603594 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603720 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603851 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.603976 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604100 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604237 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604393 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604520 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604644 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604768 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604881 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.604997 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605130 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605262 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605369 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605473 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605577 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605681 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605794 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.605899 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606002 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606119 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606229 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606350 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606472 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606621 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606744 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606856 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.606968 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607081 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607187 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607309 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607453 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607595 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607700 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607819 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.607937 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608041 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608144 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608260 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608414 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608541 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608648 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608759 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.608885 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609008 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609131 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609245 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609351 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609455 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609559 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609688 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609810 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.609934 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610055 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610178 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610300 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610421 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610559 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610702 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610825 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.610938 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611068 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611270 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611391 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611504 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611627 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611732 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611837 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.611940 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.612115 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.612241 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.612318 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.612579 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.612656 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.612893 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.613024 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.613638 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.613794 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.613794 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614012 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614135 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614242 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614346 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614449 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614553 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614666 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614666 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.614891 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615006 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615118 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615266 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615396 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615673 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615799 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.615992 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.616119 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.616300 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.616565 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.616694 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.616929 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.617105 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.617232 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.617468 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.617603 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.617821 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.617952 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.618133 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.618258 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.618550 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.618685 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.618862 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.619158 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.619292 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.619466 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.619591 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.619773 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.620056 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.620183 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.620396 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.620618 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.620755 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.620969 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.621094 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.621312 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.621456 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.621589 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.621831 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.621960 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.622204 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.622337 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.622748 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.622943 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.623781 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.623914 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.624088 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.624352 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.624538 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.624851 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.624978 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.625161 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.625450 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.625577 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.625799 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.626000 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.626127 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.626391 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.626518 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.626711 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.626845 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.627022 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.627148 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.627386 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630162 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630162 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630432 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630432 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630674 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630805 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.630931 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631054 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631185 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631314 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631527 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631655 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631778 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.631916 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632049 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632174 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632296 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632296 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632560 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632697 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632821 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.632943 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633067 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633193 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633324 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633457 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633581 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633711 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633841 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.633841 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634073 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634206 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634330 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634453 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634575 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634704 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634836 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.634960 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635091 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635215 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635336 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635458 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635588 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635712 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635856 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.635994 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636119 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636243 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636391 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636518 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636649 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636774 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.636903 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637027 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637149 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637273 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637273 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637513 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637637 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637766 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.637896 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.638020 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.638151 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.638277 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.638399 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.638521 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.638667 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.639409 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.639538 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.639709 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.639927 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.640117 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.640303 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.640586 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.640752 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.640880 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.641004 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.641126 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.641264 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.641400 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.641548 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.641829 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642034 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642213 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642406 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642557 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642683 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642807 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.642930 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643052 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643185 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643329 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643458 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643591 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643716 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643838 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.643969 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644085 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644201 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644306 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644449 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644558 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644672 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644672 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.644964 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645117 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645315 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645457 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645575 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645690 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645796 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.645909 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646015 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646130 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646242 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646355 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646460 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646572 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646698 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.646893 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647051 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647179 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647318 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647448 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647571 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647710 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647842 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.647967 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648091 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648214 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648371 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648512 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648650 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648776 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.648907 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649031 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649166 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649297 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649428 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649552 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649674 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649798 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.649918 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650051 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650181 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650314 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650476 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650603 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650786 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.650915 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.651093 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.651220 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.651401 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.651524 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.651731 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.651960 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652090 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652215 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652379 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652681 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652818 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.652980 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.653111 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.653294 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.653509 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.653734 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.653911 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654050 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654180 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654364 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654512 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654641 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654795 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.654924 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.655107 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.655243 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.655422 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.655559 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.655737 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.655864 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.656049 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.656186 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.656377 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.656522 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.656693 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.656820 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657002 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657190 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657317 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657448 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657635 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657770 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.657960 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.658096 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.658281 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.658398 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.658597 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.658728 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.658905 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659031 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659216 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659351 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659525 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659678 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659833 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.659960 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.660142 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.660278 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.660466 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.660591 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.660800 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.660927 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.661073 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.661208 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.661382 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.661523 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.661690 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.661817 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662035 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662169 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662294 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662431 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662599 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662727 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.662913 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663039 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663217 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663351 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663527 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663653 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663835 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.663960 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.664162 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.664300 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.664515 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.664642 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.664834 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.664959 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.665149 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.665284 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.665463 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.665597 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.665783 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.665917 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.666097 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.666312 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.666432 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.666628 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.666755 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.666963 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.667099 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.667383 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.667520 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.667646 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.667779 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.667976 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.668148 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.668817 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.668954 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.669080 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.669204 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.669338 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.669471 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.669610 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.669737 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.670357 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.670475 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.670596 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.670729 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.670863 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671032 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671192 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671192 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671430 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671776 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.671913 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.672149 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.672281 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.672429 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.672778 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.672909 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.673137 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.673344 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.673482 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.673773 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.673900 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.674101 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.674229 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.674422 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.674557 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.674734 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675055 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675191 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675363 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675489 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675672 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675807 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.675993 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.676121 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.676302 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.676474 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.676718 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.676843 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.676968 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.677101 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.677226 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.677527 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.677654 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.677830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.677957 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.678138 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.678440 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.678574 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.678767 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.678932 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.679058 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.679255 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.679391 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.679610 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.679744 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.679936 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680071 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680239 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680456 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680592 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680706 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680860 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.680994 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.681167 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.681395 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.681523 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.681772 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.681897 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682080 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682231 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682430 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682563 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682687 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682809 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.682970 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.683377 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.683531 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.683714 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.683882 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.684092 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.684220 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.684581 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.684711 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.684889 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.685025 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.685210 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.685346 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.685573 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.686313 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.686440 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.686697 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.687007 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.687200 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.687356 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.687578 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.687705 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.688057 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.688215 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.688529 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.688670 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.688868 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.688994 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.689217 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.689342 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.689550 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.689860 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.689983 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.690167 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.690292 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.690471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.690636 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.690796 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.691107 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.691234 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.691422 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.691631 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.691782 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.691993 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.692138 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.692310 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.692576 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.692719 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.692881 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693033 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693163 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693287 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693410 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693543 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693668 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693815 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.693929 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.694123 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.694431 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.694543 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.694738 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.694874 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.695050 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.695186 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.695391 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.695526 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.695707 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.695834 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.696022 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.696149 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.696360 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.696492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.696686 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.696884 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697026 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697160 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697293 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697479 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697626 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697750 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.697874 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698009 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698177 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698304 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698482 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698610 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698799 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.698926 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.699100 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.699220 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.699407 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.699540 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.699720 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.699849 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700025 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700161 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700373 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700502 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700714 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700841 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.700968 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.701113 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.701325 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.701494 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.701630 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.701809 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.701935 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.702133 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.702278 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.702443 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.702592 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.702792 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.702928 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.703099 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.703228 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.703410 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.703544 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.703725 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.703853 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704033 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704159 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704409 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704554 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704687 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704812 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.704964 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.705092 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.705285 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.705420 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.705594 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.705722 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.705897 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706024 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706206 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706334 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706514 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706642 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706816 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.706952 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.707121 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.707248 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.707425 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.707554 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.707729 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.707865 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.708034 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.708162 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.708351 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.708483 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.708666 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.708963 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.709093 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.709262 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.709388 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.709565 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.709693 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.709869 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710034 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710161 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710311 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710464 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710602 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710766 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.710894 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.711067 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.711195 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.711529 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.711746 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.711949 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.712065 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.712295 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.712464 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.712667 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.712916 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.713054 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.713238 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.713374 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.713557 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.713694 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.713877 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714005 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714199 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714327 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714515 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714652 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714832 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.714959 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.715147 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.715283 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.715455 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.715590 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.715768 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.715907 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.716082 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.716209 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.716421 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.716561 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.716739 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.716881 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717061 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717175 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717453 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717594 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717766 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717883 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.717999 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.718112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.718316 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.718431 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.718627 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.718755 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.718957 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.719084 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.719275 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.719396 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.719596 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.719706 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.719909 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.720050 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.720219 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.720369 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.720555 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.720681 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.720878 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721015 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721189 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721317 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721499 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721627 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721811 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.721947 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.722122 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.722257 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.722437 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.722564 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.722748 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.722876 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723088 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723219 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723347 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723514 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723651 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723758 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.723974 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.724061 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.724300 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.724447 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.724631 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.724728 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.724959 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.725061 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.725287 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.725385 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.725633 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.725721 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.725942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726036 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726255 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726356 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726576 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726663 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726887 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.726975 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.727195 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.727295 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.727507 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.727638 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.727763 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:45:01.727888 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.728205 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.728738 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.729071 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.729381 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.729698 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.730007 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.730317 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.730625 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.730932 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.731241 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.731559 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.731872 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.732181 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.733034 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.733343 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.733677 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.733986 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.734327 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.734671 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.734990 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.735340 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.736435 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.736435 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.736435 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.736875 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.737000 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.737941 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.737941 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.737941 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.739116 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.739116 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.739116 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.739116 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.740404 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.740404 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.740404 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.740404 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.740897 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.741582 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.741582 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.742670 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.742670 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.742670 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.742670 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744785 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.744785 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.745060 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.745382 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.745703 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.746036 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.746366 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.746709 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.747040 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.747398 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.747773 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.748680 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.749030 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.749377 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.749694 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.750038 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.750347 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:45:01.750618 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:45:01.790380 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO dbcounter [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Registered counter for database nova_api Jul 19 20:45:01.817637 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO dbcounter [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Registered counter for database nova_api Jul 19 20:45:01.907082 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:01.914073 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writer thread running {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:01.930038 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:01.937852 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writer thread running {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:01.972261 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.context [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59211ec6-fafb-454c-996a-b8f138acc18b(cell1) {{(pid=109736) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:45:01.975640 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:01.977289 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:01.978088 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:01.980250 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:01.982281 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO dbcounter [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Registered counter for database nova_cell0 Jul 19 20:45:01.986718 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO dbcounter [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Registered counter for database nova_cell1 Jul 19 20:45:01.994886 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:01.995090 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.context [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59211ec6-fafb-454c-996a-b8f138acc18b(cell1) {{(pid=109737) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:45:01.996762 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:02.000028 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_concurrency.lockutils [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:02.003441 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_concurrency.lockutils [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:02.003689 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writer thread running {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:02.004929 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writer thread running {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:02.005337 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_concurrency.lockutils [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:45:02.010945 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_concurrency.lockutils [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=109737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:45:02.015169 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO dbcounter [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Registered counter for database nova_cell0 Jul 19 20:45:02.019252 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO dbcounter [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Registered counter for database nova_cell1 Jul 19 20:45:02.027830 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:02.032224 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:02.034785 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writer thread running {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:02.152915 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO dbcounter [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Registered counter for database nova_cell0 Jul 19 20:45:02.160570 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_db.sqlalchemy.engines [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:02.167038 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writer thread running {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:02.215145 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writer thread running {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:02.227043 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO dbcounter [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Registered counter for database nova_cell0 Jul 19 20:45:02.237175 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG oslo_db.sqlalchemy.engines [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:45:02.242017 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writer thread running {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:45:02.514950 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: WARNING keystonemiddleware.auth_token [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:45:02.522365 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: WARNING keystonemiddleware.auth_token [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:45:02.578500 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: WARNING keystonemiddleware.auth_token [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:45:02.586153 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: WARNING keystonemiddleware.auth_token [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:45:02.866767 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: WARNING keystonemiddleware.auth_token [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:45:02.873917 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: WARNING keystonemiddleware.auth_token [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:45:02.879503 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5585344bd9c0 pid: 109736 (default app) Jul 19 20:45:02.881857 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:45:02.883098 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001959 Jul 19 20:45:02.883554 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Tue Jul 19 20:45:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:45:02.937704 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: WARNING keystonemiddleware.auth_token [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:45:02.944311 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: WARNING keystonemiddleware.auth_token [None req-7b2180eb-8f25-4cab-a5ef-9222947a53fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:45:02.949927 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5585344bd9c0 pid: 109737 (default app) Jul 19 20:46:26.265977 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:26.267095 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 19 20:46:26.267716 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:26.287258 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_api:SELECT=3 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:26.288758 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_cell0:SELECT=3 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:26.290928 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_cell1:SELECT=3 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:26.291987 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_cell0:SELECT=3 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:27.337341 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-031d953c-9efc-4d7f-a442-1796058bd29b admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:27.370277 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-031d953c-9efc-4d7f-a442-1796058bd29b admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.094887 Jul 19 20:46:27.370825 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jul 19 20:46:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:29.821148 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:29.823517 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-bcdc1e58-744d-477e-b739-06373ff9a5fa None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 19 20:46:29.823517 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:30.374955 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-8cf880c8-0371-42a4-9d07-51a00420b27d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "id": "c1"}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:30.393621 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:30.393621 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: warnings.warn(msg) Jul 19 20:46:30.431773 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-8cf880c8-0371-42a4-9d07-51a00420b27d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.598755 Jul 19 20:46:30.432398 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:30.655241 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-3bd1c8cd-c22b-42b1-a004-df79aa2bd9eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:30.658371 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:30.658371 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: warnings.warn(msg) Jul 19 20:46:30.661146 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_api:SELECT=3 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:30.661992 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_cell0:SELECT=3 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:30.662693 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_cell1:SELECT=3 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:30.663409 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:30.729036 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-3bd1c8cd-c22b-42b1-a004-df79aa2bd9eb admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287772 Jul 19 20:46:30.729641 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jul 19 20:46:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:33.072289 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-8cf880c8-0371-42a4-9d07-51a00420b27d admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:33.073318 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-8cf880c8-0371-42a4-9d07-51a00420b27d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 19 20:46:33.073908 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:33.780280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-31f8396c-0a08-4862-a771-76d6cffd2b29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:33.808500 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:33.808500 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: warnings.warn(msg) Jul 19 20:46:33.832988 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-31f8396c-0a08-4862-a771-76d6cffd2b29 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.752795 Jul 19 20:46:33.836782 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:33.846528 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-4078964a-56cb-43f7-b372-3aa17eaef04c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:33.848019 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:46:33.848019 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: warnings.warn(msg) Jul 19 20:46:33.887647 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-4078964a-56cb-43f7-b372-3aa17eaef04c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044359 Jul 19 20:46:33.897371 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jul 19 20:46:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:36.439533 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-31f8396c-0a08-4862-a771-76d6cffd2b29 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:36.440949 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-31f8396c-0a08-4862-a771-76d6cffd2b29 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jul 19 20:46:36.441529 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:36.944510 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ad4d9e8-0565-4c65-a78e-4cb60de62bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "swap": 0, "disk": 10}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:36.963813 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ad4d9e8-0565-4c65-a78e-4cb60de62bd7 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516104 Jul 19 20:46:36.964269 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:36.977016 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-ce9ae4ec-851b-482f-bc58-a0ca6eab2694 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:37.000396 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-ce9ae4ec-851b-482f-bc58-a0ca6eab2694 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027199 Jul 19 20:46:37.000981 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jul 19 20:46:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:39.510770 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ad4d9e8-0565-4c65-a78e-4cb60de62bd7 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:39.512396 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ad4d9e8-0565-4c65-a78e-4cb60de62bd7 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 19 20:46:39.512808 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:39.962676 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-a720ee96-0e3b-42a7-8ad2-fc87b14fa13a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:39.983751 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-a720ee96-0e3b-42a7-8ad2-fc87b14fa13a admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464727 Jul 19 20:46:39.984912 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:40.003695 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-2c238a49-252b-4328-af76-e980463b103e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:40.046378 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-2c238a49-252b-4328-af76-e980463b103e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047910 Jul 19 20:46:40.046971 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jul 19 20:46:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:42.349676 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-a720ee96-0e3b-42a7-8ad2-fc87b14fa13a admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:42.351189 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-a720ee96-0e3b-42a7-8ad2-fc87b14fa13a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Jul 19 20:46:42.356732 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:42.841744 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-ae67c48f-17b9-4a59-9bce-59488141b343 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:42.861836 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-ae67c48f-17b9-4a59-9bce-59488141b343 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503404 Jul 19 20:46:42.867988 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:42.876081 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-d16843a3-d243-4890-bf77-7102984ace5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:42.902866 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-d16843a3-d243-4890-bf77-7102984ace5d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031408 Jul 19 20:46:42.904916 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1335 bytes} [Tue Jul 19 20:46:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:46:45.332135 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-ae67c48f-17b9-4a59-9bce-59488141b343 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:45.333197 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-ae67c48f-17b9-4a59-9bce-59488141b343 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 19 20:46:45.333601 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:46:45.769179 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-8802fe19-2891-43d3-a0c9-3a978a087bc5 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:45.792852 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-8802fe19-2891-43d3-a0c9-3a978a087bc5 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452995 Jul 19 20:46:45.793418 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jul 19 20:46:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:46:48.291011 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-ae67c48f-17b9-4a59-9bce-59488141b343 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:48.292203 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-ae67c48f-17b9-4a59-9bce-59488141b343 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Jul 19 20:46:48.293508 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:48.745459 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-50068064-446c-4d31-9c68-1846eb1d292c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:48.764505 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-50068064-446c-4d31-9c68-1846eb1d292c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.464385 Jul 19 20:46:48.765068 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:46:48.779096 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-52a9b523-84a7-4e91-8353-b84f34eda0c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:48.805112 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-52a9b523-84a7-4e91-8353-b84f34eda0c8 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030180 Jul 19 20:46:48.805711 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jul 19 20:46:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:51.606889 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-50068064-446c-4d31-9c68-1846eb1d292c admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:51.608184 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-50068064-446c-4d31-9c68-1846eb1d292c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jul 19 20:46:51.608704 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:52.070865 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-d70c50bf-7ea1-4845-8c2b-d9c051feef70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "swap": 0}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:52.095754 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-d70c50bf-7ea1-4845-8c2b-d9c051feef70 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480402 Jul 19 20:46:52.096315 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:52.109074 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-2418815b-0d9b-4058-87b3-2a58b949dff7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:52.138207 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-2418815b-0d9b-4058-87b3-2a58b949dff7 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033197 Jul 19 20:46:52.138795 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jul 19 20:46:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:54.434028 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-d70c50bf-7ea1-4845-8c2b-d9c051feef70 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:54.435300 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-d70c50bf-7ea1-4845-8c2b-d9c051feef70 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Jul 19 20:46:54.435707 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:54.858194 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-b6a02b87-b79a-440b-b205-cfee24df9cda admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:54.884290 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-b6a02b87-b79a-440b-b205-cfee24df9cda admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.442205 Jul 19 20:46:54.885270 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:54.904120 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-accc0187-5e3d-4cdf-88b9-d86b2c82f205 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:54.932950 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-accc0187-5e3d-4cdf-88b9-d86b2c82f205 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032557 Jul 19 20:46:54.934028 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jul 19 20:46:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:46:57.321803 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-b6a02b87-b79a-440b-b205-cfee24df9cda admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:46:57.322767 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-b6a02b87-b79a-440b-b205-cfee24df9cda admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 19 20:46:57.323295 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:46:57.821398 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-8ef39561-8816-479a-a6ce-f8378a6a84b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:57.826071 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:57.843849 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-8ef39561-8816-479a-a6ce-f8378a6a84b9 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.511995 Jul 19 20:46:57.844568 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:46:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:46:57.856962 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-cf1068d8-2e82-4b8a-8628-6aa6b5065ffd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:46:57.884986 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-cf1068d8-2e82-4b8a-8628-6aa6b5065ffd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032457 Jul 19 20:46:57.885921 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jul 19 20:46:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:00.197347 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-8ef39561-8816-479a-a6ce-f8378a6a84b9 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:00.198690 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-8ef39561-8816-479a-a6ce-f8378a6a84b9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Jul 19 20:47:00.199549 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:00.643307 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-126ea578-a9a6-49ab-9fda-6b07796cff4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "vcpus": 8}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:00.666178 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-126ea578-a9a6-49ab-9fda-6b07796cff4d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461028 Jul 19 20:47:00.667041 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1282 bytes} [Tue Jul 19 20:47:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:47:00.680894 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-25bcd60e-ed96-46ef-ae41-13b179de20c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:00.715830 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-25bcd60e-ed96-46ef-ae41-13b179de20c1 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040307 Jul 19 20:47:00.716926 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1332 bytes} [Tue Jul 19 20:47:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:47:20.348595 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-126ea578-a9a6-49ab-9fda-6b07796cff4d admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:20.349604 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-126ea578-a9a6-49ab-9fda-6b07796cff4d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 19 20:47:20.350002 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:20.357353 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:20.744929 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-5529ae1b-d77d-4cb6-ba29-3db8c81ad6fa admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:20.762436 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-5529ae1b-d77d-4cb6-ba29-3db8c81ad6fa admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405802 Jul 19 20:47:20.762901 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jul 19 20:47:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:47:21.881044 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-126ea578-a9a6-49ab-9fda-6b07796cff4d admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:21.882038 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-126ea578-a9a6-49ab-9fda-6b07796cff4d admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 19 20:47:21.882430 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:22.452850 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-de265ff1-01f3-4774-bb6f-64b8bc9952ee admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:22.460656 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.wsgi [None req-de265ff1-01f3-4774-bb6f-64b8bc9952ee admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-de265ff1-01f3-4774-bb6f-64b8bc9952ee admin admin] Request method failure captured: Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Accept: application/json Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Accept-Encoding: gzip, deflate Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Connection: keep-alive Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Content-Length: 0 Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Host: 10.222.0.85 Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Openstack-Api-Version: compute 2.90 Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Openstack-System-Scope: None Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: User-Agent: python-novaclient Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Auth-Token: gAAAAABi1xhZNcY6IyvuQBIxxOFUFTJ2g8QqNwweSpEiTGb9SY2xTqGIxLSl9RIjA3_a_A3Bjcewvnrs18Ry4IshyF-YI6qvSb19owZ_qqi0jO-HbOuUTxBWM9W6lfevwXdpL3QxSNfRpSlfXzAUKOgeaCVXU1ztBsIom2HYXNOQ4F9Cz2vbQvo Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Domain-Id: None Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Domain-Name: None Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Identity-Status: Confirmed Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Is-Admin-Project: True Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Domain-Id: default Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Domain-Name: Default Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Name: admin Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Role: member,admin,reader Jul 19 20:47:22.464791 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Roles: member,admin,reader Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant: admin Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant-Name: admin Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User: admin Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Domain-Id: default Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Domain-Name: Default Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Id: adee0d7d3c614774bcfa96ea7aed77e6 Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Name: admin Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: method: > Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: exception: Flavor 42 could not be found. Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: action_args: {'id': '42'} Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:22.468022 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:22.469920 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.471942 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-de265ff1-01f3-4774-bb6f-64b8bc9952ee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:22.474098 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-de265ff1-01f3-4774-bb6f-64b8bc9952ee admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.444273 Jul 19 20:47:22.474098 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jul 19 20:47:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:47:22.478663 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-af27021d-5d4b-43d9-869b-17e1532edca2 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:22.482903 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:47:22.505870 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-af27021d-5d4b-43d9-869b-17e1532edca2 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030684 Jul 19 20:47:22.506612 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jul 19 20:47:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:47:22.517388 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-0bdd17f6-3d26-4911-a807-c18e11c8f0f7 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:22.539753 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-0bdd17f6-3d26-4911-a807-c18e11c8f0f7 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026199 Jul 19 20:47:22.540462 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jul 19 20:47:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:47:22.551411 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-8da0a84d-9487-47fc-8553-1c90ef04032a admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:22.559218 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.wsgi [None req-8da0a84d-9487-47fc-8553-1c90ef04032a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-8da0a84d-9487-47fc-8553-1c90ef04032a admin admin] Request method failure captured: Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Accept: application/json Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Accept-Encoding: gzip, deflate Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Connection: keep-alive Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Content-Length: 0 Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Host: 10.222.0.85 Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Openstack-Api-Version: compute 2.90 Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Openstack-System-Scope: None Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: User-Agent: python-novaclient Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Auth-Token: gAAAAABi1xhZNcY6IyvuQBIxxOFUFTJ2g8QqNwweSpEiTGb9SY2xTqGIxLSl9RIjA3_a_A3Bjcewvnrs18Ry4IshyF-YI6qvSb19owZ_qqi0jO-HbOuUTxBWM9W6lfevwXdpL3QxSNfRpSlfXzAUKOgeaCVXU1ztBsIom2HYXNOQ4F9Cz2vbQvo Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Domain-Id: None Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Domain-Name: None Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Identity-Status: Confirmed Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Is-Admin-Project: True Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Domain-Id: default Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Domain-Name: Default Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Name: admin Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Role: member,admin,reader Jul 19 20:47:22.563083 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Roles: member,admin,reader Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant: admin Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant-Name: admin Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User: admin Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Domain-Id: default Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Domain-Name: Default Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Id: adee0d7d3c614774bcfa96ea7aed77e6 Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Name: admin Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: method: > Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: exception: Flavor 42 could not be found. Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: action_args: {'id': '42'} Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:22.564830 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:22.565813 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:22.567358 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-8da0a84d-9487-47fc-8553-1c90ef04032a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:22.569585 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-8da0a84d-9487-47fc-8553-1c90ef04032a admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017289 Jul 19 20:47:22.569585 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jul 19 20:47:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:47:23.613700 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-0bdd17f6-3d26-4911-a807-c18e11c8f0f7 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:23.614769 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-0bdd17f6-3d26-4911-a807-c18e11c8f0f7 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 19 20:47:23.615230 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:47:24.270807 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-4ec61df0-f087-4f66-8bbe-b5c1681fe5e0 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:24.277795 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.wsgi [None req-4ec61df0-f087-4f66-8bbe-b5c1681fe5e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-4ec61df0-f087-4f66-8bbe-b5c1681fe5e0 admin admin] Request method failure captured: Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Accept: application/json Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Accept-Encoding: gzip, deflate Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Connection: keep-alive Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Content-Length: 0 Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Host: 10.222.0.85 Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Openstack-Api-Version: compute 2.90 Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Openstack-System-Scope: None Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: User-Agent: python-novaclient Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Auth-Token: gAAAAABi1xhbOFyGstnp5B08BYDiPgadqhx6H7_oozHL1k_WCRKm3tJdg8rVbmFl_CbDBOlSDRAikkRx7REYXqG0RJxyqxciEz48NpoYW3xXqlv-ofYMe2nM7BI6JbJvspGNBmiIVDrwYPkZAAtMwZVVIs_BpDpjZe4GqZIm3m2gxBNk30JnWg8 Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Domain-Id: None Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Domain-Name: None Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Identity-Status: Confirmed Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Is-Admin-Project: True Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Domain-Id: default Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Domain-Name: Default Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Name: admin Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Role: member,admin,reader Jul 19 20:47:24.279471 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Roles: member,admin,reader Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant: admin Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant-Name: admin Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User: admin Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Domain-Id: default Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Domain-Name: Default Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Id: adee0d7d3c614774bcfa96ea7aed77e6 Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Name: admin Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: method: > Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: exception: Flavor 84 could not be found. Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: action_args: {'id': '84'} Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:24.281280 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:24.282555 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.284677 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-4ec61df0-f087-4f66-8bbe-b5c1681fe5e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:24.286692 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-4ec61df0-f087-4f66-8bbe-b5c1681fe5e0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.522416 Jul 19 20:47:24.286692 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jul 19 20:47:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:47:24.292764 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-11f0a970-e758-453b-aa12-dc7123db078c admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:24.307539 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-11f0a970-e758-453b-aa12-dc7123db078c admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018326 Jul 19 20:47:24.308117 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jul 19 20:47:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:47:24.318992 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-bc2f9976-319a-4022-9ec7-a290d9d02c08 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:24.334404 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-bc2f9976-319a-4022-9ec7-a290d9d02c08 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019442 Jul 19 20:47:24.335100 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jul 19 20:47:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:47:24.345548 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-d8111c99-c1d3-47b6-bbde-caa130f208ce admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:24.351015 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.wsgi [None req-d8111c99-c1d3-47b6-bbde-caa130f208ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-d8111c99-c1d3-47b6-bbde-caa130f208ce admin admin] Request method failure captured: Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Accept: application/json Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Accept-Encoding: gzip, deflate Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Connection: keep-alive Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Content-Length: 0 Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Host: 10.222.0.85 Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Openstack-Api-Version: compute 2.90 Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Openstack-System-Scope: None Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: User-Agent: python-novaclient Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Auth-Token: gAAAAABi1xhbOFyGstnp5B08BYDiPgadqhx6H7_oozHL1k_WCRKm3tJdg8rVbmFl_CbDBOlSDRAikkRx7REYXqG0RJxyqxciEz48NpoYW3xXqlv-ofYMe2nM7BI6JbJvspGNBmiIVDrwYPkZAAtMwZVVIs_BpDpjZe4GqZIm3m2gxBNk30JnWg8 Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Domain-Id: None Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Domain-Name: None Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Identity-Status: Confirmed Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Is-Admin-Project: True Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Domain-Id: default Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Domain-Name: Default Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Name: admin Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Role: member,admin,reader Jul 19 20:47:24.352580 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Roles: member,admin,reader Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant: admin Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant-Name: admin Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User: admin Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Domain-Id: default Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Domain-Name: Default Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Id: adee0d7d3c614774bcfa96ea7aed77e6 Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Name: admin Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: method: > Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: exception: Flavor 84 could not be found. Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: action_args: {'id': '84'} Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:24.355492 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:24.356519 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:24.357712 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-d8111c99-c1d3-47b6-bbde-caa130f208ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:24.358911 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-d8111c99-c1d3-47b6-bbde-caa130f208ce admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012705 Jul 19 20:47:24.358911 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Tue Jul 19 20:47:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:47:25.489598 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-bc2f9976-319a-4022-9ec7-a290d9d02c08 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:25.490689 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-bc2f9976-319a-4022-9ec7-a290d9d02c08 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Jul 19 20:47:25.491095 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:26.051332 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-82f589e1-746a-498d-baef-7c64ad89c444 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:26.058047 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.wsgi [None req-82f589e1-746a-498d-baef-7c64ad89c444 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-82f589e1-746a-498d-baef-7c64ad89c444 admin admin] Request method failure captured: Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Accept: application/json Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Accept-Encoding: gzip, deflate Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Connection: keep-alive Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Content-Length: 0 Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Host: 10.222.0.85 Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Openstack-Api-Version: compute 2.90 Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Openstack-System-Scope: None Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: User-Agent: python-novaclient Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Auth-Token: gAAAAABi1xhdbEYr7BbeZWKLXcGRDDt2aKwA8Yrr7ph8RaX8i5OlQDcQdHiyDnCns7200GaIZ--I3miD02DIokkVm11eYIVjsu3qCnb90TWuPWSO3l3foCtSu_ADFqR28VOKmJU7Xtc0z2PFlKBXBA9NrgrN9yabZnIbESh_5nk6MYfqNDF70Ho Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Domain-Id: None Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Domain-Name: None Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Identity-Status: Confirmed Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Is-Admin-Project: True Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Domain-Id: default Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Domain-Name: Default Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Project-Name: admin Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Role: member,admin,reader Jul 19 20:47:26.059844 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Roles: member,admin,reader Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant: admin Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-Tenant-Name: admin Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User: admin Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Domain-Id: default Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Domain-Name: Default Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Id: adee0d7d3c614774bcfa96ea7aed77e6 Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: X-User-Name: admin Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: method: > Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: exception: Flavor 451 could not be found. Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: action_args: {'id': '451'} Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:26.062499 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:26.064083 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.066328 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-82f589e1-746a-498d-baef-7c64ad89c444 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:26.069100 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-82f589e1-746a-498d-baef-7c64ad89c444 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.431786 Jul 19 20:47:26.069100 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jul 19 20:47:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:47:26.072896 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-8edf8d96-c258-4d84-80a1-92153bf11fb0 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:26.088064 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-8edf8d96-c258-4d84-80a1-92153bf11fb0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019588 Jul 19 20:47:26.088700 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jul 19 20:47:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:47:26.098576 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:26.112541 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017492 Jul 19 20:47:26.113101 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Tue Jul 19 20:47:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:47:26.123390 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-4a1e97ef-d8d4-459f-81e6-eeaf93055603 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:26.129176 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.wsgi [None req-4a1e97ef-d8d4-459f-81e6-eeaf93055603 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-4a1e97ef-d8d4-459f-81e6-eeaf93055603 admin admin] Request method failure captured: Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Accept: application/json Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Accept-Encoding: gzip, deflate Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Connection: keep-alive Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Content-Length: 0 Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Host: 10.222.0.85 Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Openstack-Api-Version: compute 2.90 Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Openstack-System-Scope: None Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: User-Agent: python-novaclient Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Auth-Token: gAAAAABi1xhdbEYr7BbeZWKLXcGRDDt2aKwA8Yrr7ph8RaX8i5OlQDcQdHiyDnCns7200GaIZ--I3miD02DIokkVm11eYIVjsu3qCnb90TWuPWSO3l3foCtSu_ADFqR28VOKmJU7Xtc0z2PFlKBXBA9NrgrN9yabZnIbESh_5nk6MYfqNDF70Ho Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Domain-Id: None Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Domain-Name: None Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Identity-Status: Confirmed Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Is-Admin-Project: True Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Domain-Id: default Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Domain-Name: Default Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Project-Name: admin Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Role: member,admin,reader Jul 19 20:47:26.130735 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Roles: member,admin,reader Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3f322b7a5256429ea77db2c08c676fad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant: admin Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant-Id: 3f322b7a5256429ea77db2c08c676fad Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-Tenant-Name: admin Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User: admin Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Domain-Id: default Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Domain-Name: Default Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Id: adee0d7d3c614774bcfa96ea7aed77e6 Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: X-User-Name: admin Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: method: > Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: exception: Flavor 451 could not be found. Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: action_args: {'id': '451'} Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:47:26.132395 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:26.133649 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: ERROR nova.api.openstack.wsgi Jul 19 20:47:26.135048 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-4a1e97ef-d8d4-459f-81e6-eeaf93055603 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:47:26.136876 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-4a1e97ef-d8d4-459f-81e6-eeaf93055603 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013187 Jul 19 20:47:26.136876 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jul 19 20:47:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 20:47:27.186310 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:27.187388 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 19 20:47:27.188037 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:27.919408 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-702c3476-186b-41f2-b5bc-d166f8e56f0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:27.938390 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-702c3476-186b-41f2-b5bc-d166f8e56f0d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.605580 Jul 19 20:47:27.938948 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jul 19 20:47:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:47:29.003801 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:29.004927 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Jul 19 20:47:29.005398 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:29.659255 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-b22e6877-3744-4b56-bf06-463b0de1f149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:29.680859 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-b22e6877-3744-4b56-bf06-463b0de1f149 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.533000 Jul 19 20:47:29.681547 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jul 19 20:47:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:47:30.725535 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:30.726903 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Jul 19 20:47:30.727453 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:31.380054 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-a4a6e8a1-9283-498d-a7ea-ed8f8ae7b5bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:31.400012 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-a4a6e8a1-9283-498d-a7ea-ed8f8ae7b5bd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.527394 Jul 19 20:47:31.400626 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jul 19 20:47:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:47:32.442370 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:32.443375 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 19 20:47:32.443783 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:47:33.133408 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-cabad0ad-487c-40b6-a41d-ff02a2f35f02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:47:33.155374 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-cabad0ad-487c-40b6-a41d-ff02a2f35f02 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.571367 Jul 19 20:47:33.155973 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Tue Jul 19 20:47:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 20:47:34.398538 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:34.399798 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 Jul 19 20:47:34.400275 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:47:34.997989 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-6f909a34-a381-4ba5-b44b-d30677c75abd admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:47:35.034664 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-6f909a34-a381-4ba5-b44b-d30677c75abd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.496376 Jul 19 20:47:35.035646 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Tue Jul 19 20:47:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:48:33.106539 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.107613 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-1ac8b6e3-92c8-4ccc-97aa-e4f83f1a8aff admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 19 20:48:33.108019 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 930 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:48:33.119591 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:33.588569 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-3890771c-164f-4b6d-b796-0c744d7e376c admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.608836 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-3890771c-164f-4b6d-b796-0c744d7e376c admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.494059 Jul 19 20:48:33.609430 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1291 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:48:33.630898 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG dbcounter [-] [109737] Writing DB stats nova_api:SELECT=14 {{(pid=109737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:33.635319 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-239c1c23-7f6c-4a7d-b3f1-475f81c99c92 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.643892 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-239c1c23-7f6c-4a7d-b3f1-475f81c99c92 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014377 Jul 19 20:48:33.644498 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1282 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:33.656623 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-ac154630-73d7-48ad-99b0-f3404b41b87e admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.664597 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-ac154630-73d7-48ad-99b0-f3404b41b87e admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011576 Jul 19 20:48:33.665161 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1285 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:33.677150 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.685845 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012026 Jul 19 20:48:33.686433 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1285 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:48:33.699038 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-c848a946-e804-4c3e-ad5f-02a57b26962e admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:48:33.707195 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-c848a946-e804-4c3e-ad5f-02a57b26962e admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012476 Jul 19 20:48:33.707764 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1282 bytes} [Tue Jul 19 20:48:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:52:09.359724 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:09.360698 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 19 20:52:09.361131 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:09.520754 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_api:SELECT=6 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:09.731018 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-af848a62-747d-4d8d-848c-b0488d7689f1 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:09.732177 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:52:09.732177 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: warnings.warn(msg) Jul 19 20:52:09.733419 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-af848a62-747d-4d8d-848c-b0488d7689f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:09.733860 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-af848a62-747d-4d8d-848c-b0488d7689f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:09.734646 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-af848a62-747d-4d8d-848c-b0488d7689f1 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:09.735071 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-af848a62-747d-4d8d-848c-b0488d7689f1 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:09.769437 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-af848a62-747d-4d8d-848c-b0488d7689f1 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.250542 Jul 19 20:52:09.770018 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jul 19 20:52:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:52:10.802523 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:10.803709 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Jul 19 20:52:10.804145 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:11.029928 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-0973ca7b-6019-480a-9319-7d92dca8d217 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:11.031171 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:52:11.031171 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: warnings.warn(msg) Jul 19 20:52:11.032441 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-0973ca7b-6019-480a-9319-7d92dca8d217 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.032884 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-0973ca7b-6019-480a-9319-7d92dca8d217 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:11.033667 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-0973ca7b-6019-480a-9319-7d92dca8d217 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:11.034086 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-0973ca7b-6019-480a-9319-7d92dca8d217 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:11.055047 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-0973ca7b-6019-480a-9319-7d92dca8d217 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084028 Jul 19 20:52:11.055645 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jul 19 20:52:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:52:22.395721 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:22.396750 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 Jul 19 20:52:22.397149 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:52:22.539293 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_cell0:SELECT=4 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:22.540051 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_cell1:SELECT=4 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:22.541117 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG dbcounter [-] [109736] Writing DB stats nova_api:SELECT=8 {{(pid=109736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:22.602404 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-8dbfc049-f5b9-4b80-b9b7-aa1524d30a19 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:22.603575 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:52:22.603575 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: warnings.warn(msg) Jul 19 20:52:22.604833 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-8dbfc049-f5b9-4b80-b9b7-aa1524d30a19 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:22.605341 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-8dbfc049-f5b9-4b80-b9b7-aa1524d30a19 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:22.606188 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-8dbfc049-f5b9-4b80-b9b7-aa1524d30a19 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:22.606615 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-8dbfc049-f5b9-4b80-b9b7-aa1524d30a19 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:22.632950 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-8dbfc049-f5b9-4b80-b9b7-aa1524d30a19 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.098782 Jul 19 20:52:22.633445 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jul 19 20:52:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:52:23.530228 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: DEBUG nova.api.openstack.wsgi [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] Calling method '>' {{(pid=109737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:23.531275 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: INFO nova.api.openstack.requestlog [None req-fdb093b0-b36a-4467-a7b7-f716118f4c60 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jul 19 20:52:23.531673 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: [pid: 109737|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Tue Jul 19 20:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:52:23.729790 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG nova.api.openstack.wsgi [None req-fa1824b1-7def-4cee-9da8-e26d281213f3 admin admin] Calling method '>' {{(pid=109736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:52:23.730947 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:52:23.730947 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: warnings.warn(msg) Jul 19 20:52:23.732149 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-fa1824b1-7def-4cee-9da8-e26d281213f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.732612 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-fa1824b1-7def-4cee-9da8-e26d281213f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.733418 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-fa1824b1-7def-4cee-9da8-e26d281213f3 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:52:23.733833 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: DEBUG oslo_concurrency.lockutils [None req-fa1824b1-7def-4cee-9da8-e26d281213f3 admin admin] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:52:23.755955 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: INFO nova.api.openstack.requestlog [None req-fa1824b1-7def-4cee-9da8-e26d281213f3 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079407 Jul 19 20:52:23.756526 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: [pid: 109736|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Tue Jul 19 20:52:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:53:23.272290 dv-cinder-749155-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 20:53:23.272881 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: Tue Jul 19 20:53:23 2022 - graceful shutdown triggered... Jul 19 20:53:23.273313 dv-cinder-749155-8-iscsi devstack@n-api.service[109736]: Gracefully killing worker 1 (pid: 109736)... Jul 19 20:53:23.274495 dv-cinder-749155-8-iscsi devstack@n-api.service[109737]: Gracefully killing worker 2 (pid: 109737)... Jul 19 20:53:24.274049 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: worker 1 buried after 1 seconds Jul 19 20:53:24.274049 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: worker 2 buried after 1 seconds Jul 19 20:53:24.274049 dv-cinder-749155-8-iscsi devstack@n-api.service[109735]: goodbye to uWSGI. Jul 19 20:53:24.275623 dv-cinder-749155-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 19 20:53:24.276178 dv-cinder-749155-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 20:53:24.279093 dv-cinder-749155-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 20:53:24.288818 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 20:53:24 2022] *** Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: nodename: dv-cinder-749155-8-iscsi Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: machine: x86_64 Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: clock source: unix Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: pcre jit disabled Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: detected number of CPU cores: 4 Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: current working directory: / Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: detected binary path: /usr/bin/uwsgi-core Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: your processes number limit is 47680 Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: your memory page size is 4096 bytes Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: detected max file descriptor number: 2048 Jul 19 20:53:24.290966 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: lock engine: pthread robust mutexes Jul 19 20:53:24.292166 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: thunder lock: enabled Jul 19 20:53:24.292166 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 20:53:24.292166 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 20:53:24.339290 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: Python main interpreter initialized at 0x557c3d8d69c0 Jul 19 20:53:24.339290 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: python threads support enabled Jul 19 20:53:24.339290 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: your server socket listen backlog is limited to 100 connections Jul 19 20:53:24.339290 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: your mercy for graceful operations on workers is 90 seconds Jul 19 20:53:24.339749 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 20:53:24.339749 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: *** Operational MODE: preforking *** Jul 19 20:53:24.340028 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: *** uWSGI is running in multiple interpreter mode *** Jul 19 20:53:24.340028 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: spawned uWSGI master process (pid: 124261) Jul 19 20:53:24.342472 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: spawned uWSGI worker 1 (pid: 124277, cores: 1) Jul 19 20:53:24.342472 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: spawned uWSGI worker 2 (pid: 124278, cores: 1) Jul 19 20:53:24.342472 dv-cinder-749155-8-iscsi devstack@n-api.service[124261]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 20:53:24.340232 dv-cinder-749155-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 20:53:25.027290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:53:25.030632 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 20:53:26.312050 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:53:26.312050 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: from cryptography.utils import int_from_bytes Jul 19 20:53:26.313173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:53:26.313173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: from cryptography.utils import int_from_bytes Jul 19 20:53:26.399697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:53:26.399697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: from cryptography.utils import int_from_bytes Jul 19 20:53:26.400508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:53:26.400508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: from cryptography.utils import int_from_bytes Jul 19 20:53:28.778883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:53:28.781071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:53:28.781071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:53:28.781071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:53:28.781071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:53:28.781071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.781071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.781807 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.781807 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.782083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.782251 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.782833 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.783088 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.783271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.783488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.783758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.784165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-8-iscsi {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.784525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.784848 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.785167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.785496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.785814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.786142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.786456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.786966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.788746 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.789230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.789781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.790247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.790683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.791115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.791597 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.792012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.792517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.792934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.793482 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-8-iscsi {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.793910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.794956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.795458 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.796172 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.796642 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.797227 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.798104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.798653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.799080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.800094 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.800604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.801035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.801472 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.801885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.806975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.807482 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.808421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.808849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.809269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.809693 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.810124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.810594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.811001 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.811449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.811903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.812361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.812815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.813483 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.813910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.814444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.814792 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.815824 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.816278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.816723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.817143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.817694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.818403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.818812 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.819234 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.819652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.820090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.820579 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.820987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.821337 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.821743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.822155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.822584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.822998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.823414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.823880 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.824291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.825057 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.825463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.825859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.826348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.826747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.827140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.827595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.828470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.828687 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.829164 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.829488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.829883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.831073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.831073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.831073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.831565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.831804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.832254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.832678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.833067 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.836808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.840379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.843209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.844883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.844883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.844883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.844883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.845697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:53:28.845697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:53:28.846700 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.846932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:53:28.847155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.847382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:53:28.847615 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.847829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:53:28.847829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.848248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.848507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.848742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.848965 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.849185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.849401 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.849401 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.849852 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.850062 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.850062 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.850500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.850770 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.852453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.852453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.852913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.852913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.853309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.853519 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.853753 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.853753 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.854193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-8-iscsi {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.854431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.854674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.854890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.855138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.855138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.855572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.855809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.856035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.856275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.856553 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.856782 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.856782 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.857234 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.857464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.857751 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.857994 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.858218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.858473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.858473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.858928 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.859173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.859173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.859623 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.859852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.860101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.860383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.860383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.860844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.861075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.863206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.863459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.863824 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.864069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-8-iscsi {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.864069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.864069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.864822 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.865082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.865314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.865573 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.865573 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.865984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.866200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.866200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.866200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.866200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.866995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.867203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.867203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.867608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.867814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.867814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.868208 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.868440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.868440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.868843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.869087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.869087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.869510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.869736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.869980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.870214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.870214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.870656 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.870900 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.870900 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.870900 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.870900 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.872601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.873494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.873494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.873494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.874171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.874405 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.874405 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.874405 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.875073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.875319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.875319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.875774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.876003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.876003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.876003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.876701 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.876942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.876942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.876942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.877601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.877932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.877932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.878369 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.878592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.878592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.879024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.879268 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.879268 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.879698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.879844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.879844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.880126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.880287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.880287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.880739 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.880967 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.881210 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.881452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.881682 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.882630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.882630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.883766 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.884023 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.884264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.884531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.884531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.885006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.885255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.885255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.885255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.885945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.886189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.886411 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.886411 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.886856 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.887104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.887350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.887582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.887826 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.888054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.888296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.888296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.888296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.888989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.889210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.889350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.889503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.889655 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.889796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.889958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.889958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.890257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.890397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.890549 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.890707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.890855 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.891007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.891007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.891277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.891435 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.891584 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.891584 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.891854 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.891993 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.892524 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.892849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.892849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.892849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.894300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.894457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.894457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.894741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.894890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.895029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.895182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.895323 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.895470 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.895631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.895778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.895929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.896088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.896088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.896399 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.896551 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.896551 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.896839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.896990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.897143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.897282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.897434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.897574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.897574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.897857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.897997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.897997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.898269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.898409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.898557 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.898705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.898705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.899026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.899199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.899199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.899199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.899728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.899956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.900184 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.900464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.900464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.901023 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.901252 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.901252 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.901681 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.901899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:53:28.902137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.902885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.903303 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.903527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.903759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.904422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.904688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.904688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.905130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.905375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.905604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.905839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.905839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.906282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.906527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.906771 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.906996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.906996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.907436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.907436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.907891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.908124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.908124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.908701 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.908968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.909725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.909973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.910196 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.910421 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.910654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.910877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.910877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.911309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.911549 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.911716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.911876 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.912030 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.912171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.912315 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.912485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.912485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.913299 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.913453 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.913453 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.913724 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.913876 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.914031 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.914183 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.914360 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.914851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915002 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915302 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915597 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.915895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.916178 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.916319 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.916497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.916646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.916646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.916931 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.917083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.917285 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.917433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.917614 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.917909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.918070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.918237 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.918381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.918556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.918689 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.918953 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.919053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.919315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.919595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.919746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.919930 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.920088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.920249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.920420 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.920602 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.920749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.920944 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.921135 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.921438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.921691 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.921956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.921956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.922461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.922730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.922730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.923719 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.923963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.924210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.924528 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.924528 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.925397 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.925648 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.925648 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.926136 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.926398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.926654 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.926895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.926895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.927370 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.927627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.927872 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.928136 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.928136 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.928501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.928653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.928653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.928954 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.929998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.930144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.930298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.930298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.930576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.930731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.930731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931186 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931186 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.931934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.932220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.932403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.932403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.932687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.932844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.932844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.933149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.933789 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.933789 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.934099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.934255 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.934409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.934565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.934565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.934874 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.935284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.935284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.935584 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.935785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.935951 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.936099 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.936099 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.936409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.936575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.936575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.936885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.937040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.937190 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.937338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.937485 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.937817 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.938220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.938378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.938616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.938770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.938993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.939159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.939411 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.939722 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.939877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.940032 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.940305 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.940750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.940914 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.941150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.941639 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.941806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.941806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.942097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.942252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.942452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.942640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.942801 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.943114 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.943280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.943562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.943938 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.944110 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.944270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.944527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.944688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.944688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.944981 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.945155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.945502 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.945654 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.945808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.945963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.946129 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.946278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.946556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.946726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.946881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.947133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.947300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.947447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.947694 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.947849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.948060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.948220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.948432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.948747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.948907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.949063 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.949391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.949611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.949772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.949984 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.950138 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.950337 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.950515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.950678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.950990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.951155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.951365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.951614 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.951767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.952037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.952189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.952405 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.952668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.952820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.953000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.953267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.953421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.953709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954695 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.954985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.955142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.955592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.955767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.955767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.956617 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.956778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.956946 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.957183 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.957346 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.957550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.957755 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.957916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.958173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.958334 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.958483 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.958778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.958929 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.959084 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.959468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.959798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.960020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.960175 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.960519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.960693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.961024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.961187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.962198 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.962424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.962585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.962585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.962883 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.963043 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.963293 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.963449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.963449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.964483 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.964663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.964663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.964953 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.965100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.965100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.965100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.965549 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.965912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.965912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.966218 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.966366 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.966526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.966685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.966685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.966979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.967144 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.967144 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.967465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.967614 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.967760 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.967904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.968069 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.968367 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.968532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.968694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.968986 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.969142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.969289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.969556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.969712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.969889 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.970174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.970341 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.970497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.970664 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.970814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.971107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.971276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.971471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.972246 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.972535 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.972699 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.972864 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.973012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.973284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.973444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.973606 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.973903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.974174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.974356 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.974703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.974892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.974892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.975192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.976425 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.976601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.976601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.977135 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.977322 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.977322 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.977644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.977807 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.977958 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.978115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.978115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.978410 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.978572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.978572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.978859 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979021 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979021 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979769 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.979916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.980062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.980208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.980442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.980678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.981085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.981732 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.981899 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.982061 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.982231 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.982231 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.982545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.982780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.982780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.983242 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.983496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.983496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.983959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.984214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.984214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.985184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.985437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.985702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.985916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.985916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.986528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.986696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.986855 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987371 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987529 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.987990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.988150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.988296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.988515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.988674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.988830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.988978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.989132 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.989398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.989561 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.989742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.990002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.990157 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.990609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.990760 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.991359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.991911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.992240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.992434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.992586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.992772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.993114 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.993231 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.993485 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.993705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.993892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.994199 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.994671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.994798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.994997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.995261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.995373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.995625 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.995844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.995949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.996270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.996435 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.996636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.996973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.997147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.997381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.997531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.997696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.998116 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.998288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.998449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.998681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.998837 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.999058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.999238 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.999393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.999700 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:28.999860 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.000008 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.000380 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.000502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.000660 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.000952 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.001126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.001315 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.001550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.001722 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.001940 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.002099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.002254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.002572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.002932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.003103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.003258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.003544 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.003746 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.004100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.004217 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.004309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.004656 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.004853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.005037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.005275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.005408 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.005601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.005840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.005963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.006207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.006413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.006537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.006912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.007072 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.007235 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.007412 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.007576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.007736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.008029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.008165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.008484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.008658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.008799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.009180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.009346 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.009492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.009655 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.009881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.010037 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.010185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.010509 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.010652 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.010830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.011110 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.011267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.011448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.011760 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.012067 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.012194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.012422 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.012729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.012870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.013312 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.013884 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.014001 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.014218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.014449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.014550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.014884 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.015071 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.015261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.015605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.015709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.015905 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.016180 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.016282 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.016536 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.016842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.016955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.017179 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.017358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.017524 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.017791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.017889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.018107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.018945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.019441 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.019604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.019781 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.019934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.019934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.020233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.020428 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.020428 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.020742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.020904 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.021064 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.021280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.021440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.021662 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.021821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.021997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.022209 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.022383 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.022545 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.022792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.023003 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.023170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.023369 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.023540 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.023808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.023991 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.024155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.024672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.024974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.025296 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.025888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.026061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.026061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.026541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.027218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.027392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.027668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.027839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.027995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.027995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.028307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.028501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.028664 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.028817 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.029020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.029879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.030070 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.030236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.030398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.030563 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.030717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.030944 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.031119 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.031338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.031579 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.031928 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.032176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.032372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.032622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.032828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.032989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.033259 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.033426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.033589 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.033888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.034140 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.034403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.034565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.034720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.034881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.035082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.035250 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.035535 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.035693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.035882 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.036129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.036288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.036487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.036768 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.036930 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.037098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.037356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.037525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.037721 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.037921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.038091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.038388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.038556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.038718 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.039004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.039220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.039396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.039618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.039778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.039931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.040193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.040402 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.040577 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.040774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.040936 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.041157 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.041349 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.041521 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.041772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.042013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.042179 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.042406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.042573 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.042728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.043245 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.043423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.043423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.044587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.044769 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.044769 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.045084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.045247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.045413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.045708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.045708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046650 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046811 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.046973 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.047146 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.047302 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.047454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.047717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.047992 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.048244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.048539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.048856 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.049223 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.049393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.050293 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.050475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.050814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.050997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.051371 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.051506 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.051906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.052072 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.052361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.052715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.052885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.053233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.053507 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.053771 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.053915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.054368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.054518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.054768 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.054913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.055055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.055316 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.055450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.055637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.055908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.056046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.056274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.056469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.056607 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.056934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.057077 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.057255 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.058383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.058561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.058561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.058825 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.058947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.058947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.059206 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.059338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.059484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.059626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.059626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.059894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.060036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.060036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.060296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.060534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.060712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.060910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.061086 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.061220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.061426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.061575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.061806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.062031 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.062242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.062395 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.062529 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.062703 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.063359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.063532 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.063765 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.063916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.064059 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.064204 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.064412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.064566 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.064989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.065156 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.065527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.065680 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.065815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.066127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.066285 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.066420 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.066747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.066884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.067061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.067307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.067454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.067708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.067921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.068058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.068515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.068679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.068949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.069091 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.069276 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.069618 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.069761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.069953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.070196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.070341 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.070555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.070971 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.071333 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.071499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.071499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.071762 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.072719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.072892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.073054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.073054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.073470 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.073771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.073771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.074261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.074421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.074421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.074735 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.074920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.074920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.075336 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.075525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.075525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.075862 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.076009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.076009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.076591 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.076758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.076913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077660 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.077994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.078449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.078601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.078601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.078888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.079045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.079204 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.079359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.079523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.079764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.079925 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.080356 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.080661 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.081639 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.081873 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.082048 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.082048 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.082330 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.082575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.082575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.082878 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.083028 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.083218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.083660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.083947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.084294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.084657 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.084657 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.085182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.085576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.085801 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.085958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.085958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.086282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.086483 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.086898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.087091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.087291 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.087519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.087681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.087924 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.088170 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.088432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.088432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.088929 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.089219 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.089478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.089679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.089679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.090124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.090361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.090361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.090834 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.091080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.091080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.091526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.091815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.091815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.092289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.092516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.092516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.092814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.092963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.092963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.093358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.093612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.093612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.094081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.094338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.094338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.094782 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.094932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.094932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.095220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.095385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.095658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.095834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.095834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.096142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.096290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.096290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.096705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.096996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.096996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.097288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.097436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.097590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.097762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.097762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.097762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.098489 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.098645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.098793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099799 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.099958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.100253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.100447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.100596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.100747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.100905 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.101170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.101322 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.101502 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.101760 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.101916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.102122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.102320 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.102481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.102741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.102905 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.103062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.103376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.103536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.103683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.103995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.104155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.104317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105152 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.105948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.106151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.106482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.106587 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.106806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.107036 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.107130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.107429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.107757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.107870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.108151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.108421 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109193 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109193 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109486 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109486 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109634 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.109715 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.110114 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.110220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.110311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:53:29.110711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.111263 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.111969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.112981 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.113593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.114202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.114787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.115444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.116024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.116563 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.117177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.118029 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.118601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.119381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.119989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.120633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.121253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.121848 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.122391 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.123029 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.123544 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.124097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.124702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.125285 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.125843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.126357 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.126909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.127460 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.128152 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.128775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.129342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.129880 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.130497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.131040 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.131603 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.132187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.132775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.133742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.134288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.134775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.135296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.135820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.136476 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.137013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.137606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.138195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.138785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.139368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.139977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.141615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.141615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.141895 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.142448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.143008 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.143607 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.144166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.144781 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.145408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.145865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.146410 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.146956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.147485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.148040 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.148718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.149484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.150141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.150653 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.151193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.152009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.152263 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.153243 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.153667 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.154290 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.154869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.155564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.156250 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.157053 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.157647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.158246 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.159441 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.159934 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.160777 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.161094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.161681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.162334 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.162842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.163576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.165129 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.165129 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.166118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.166731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.167321 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.167894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.168512 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.169095 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.169660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.170229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.170784 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.171369 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.171942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.172577 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.173170 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.173780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.174382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.175020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.175597 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.176158 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.178007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.178765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.179358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.179943 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.180567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.181127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.181700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.182265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.182916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.183322 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.183826 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.184367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.184898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.185445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.186236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.186942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.187424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.188239 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.188854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.189408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.189950 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.191531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.192099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.192726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.193301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.193883 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.194451 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.195028 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.195606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.196137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.196712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.197294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.197821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.198358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.199097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.199681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.200253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.200849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.201376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.202313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.202918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.203628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.204185 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.204764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.205308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.206141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.206727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.207282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.207846 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.208454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.209032 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.209581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.210137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.210716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.211571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.212050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.212651 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.213210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.213805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.214463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.214890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.215439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.215979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.216542 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.217100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.217649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.218207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.219101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.219352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.219912 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.220489 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.221054 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.222148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.222726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.223375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.223983 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.224566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.225130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.225729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.226300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.226897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.227484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.228321 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.228970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.229631 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.230480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.231079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.231673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.232296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.232912 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.233440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.234007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.234552 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.235151 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.235728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.236310 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.236920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.237585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.238136 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.238715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.239270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.239836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.240433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.240992 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.241571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.242145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.242712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.243303 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.243933 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.244543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.245111 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.245670 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.246220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.246753 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.249541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.249541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.249541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.249541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.249541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.250120 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.250676 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.251500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.252060 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.253376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.253969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.254543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.255123 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.255711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.256289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.256907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.257476 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.258065 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.258939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.259515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.260100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.260685 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.261256 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.261848 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.262399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.262990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.263539 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.264084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.264654 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.265258 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.265821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.266424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.266990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.267555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.268119 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.268852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.269405 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.269970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.270544 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.271090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.271672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.272226 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.272796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.273354 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.274127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.274700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.275441 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.276058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.276709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.277267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.277852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.278419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.278955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.279574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.280103 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.280690 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.281270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.281822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.282412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.282980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.283554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.283668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO dbcounter [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Registered counter for database nova_api Jul 19 20:53:29.284690 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.285247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.285788 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.286349 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.286898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.287429 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.287957 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.288559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.289142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.289730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.290292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.290864 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.291458 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.292012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.292619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.293175 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.293761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.294340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.294933 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.296357 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.296357 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.297088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.297520 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.298443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.299049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.299738 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.301272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.301272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.301671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.302257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.302877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.303463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.304031 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.304640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.305183 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:53:29.305592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124278) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:53:29.306244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.313970 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writer thread running {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.374266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.context [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59211ec6-fafb-454c-996a-b8f138acc18b(cell1) {{(pid=124277) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:53:29.379145 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:29.380830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:29.381666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:29.383713 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:29.385806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO dbcounter [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Registered counter for database nova_cell0 Jul 19 20:53:29.390248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO dbcounter [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Registered counter for database nova_cell1 Jul 19 20:53:29.399697 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.405869 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.410252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writer thread running {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.551516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writer thread running {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.563587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO dbcounter [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Registered counter for database nova_api Jul 19 20:53:29.564133 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO dbcounter [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Registered counter for database nova_cell0 Jul 19 20:53:29.570973 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_db.sqlalchemy.engines [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.575736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writer thread running {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.597864 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.604819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writer thread running {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.662505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.context [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),59211ec6-fafb-454c-996a-b8f138acc18b(cell1) {{(pid=124278) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 20:53:29.667126 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:29.668811 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:29.669666 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:53:29.671698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:53:29.673763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO dbcounter [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Registered counter for database nova_cell0 Jul 19 20:53:29.678370 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO dbcounter [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Registered counter for database nova_cell1 Jul 19 20:53:29.686362 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.690432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.693684 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writer thread running {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.848792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writer thread running {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.863171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO dbcounter [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Registered counter for database nova_cell0 Jul 19 20:53:29.875315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124278) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:53:29.881092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writer thread running {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:53:29.899593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:53:29.907131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:53:30.210298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:53:30.218894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:53:30.250727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:53:30.257090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: WARNING keystonemiddleware.auth_token [None req-e1a57b8e-165a-49d2-85ea-fcc6e3de0256 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:53:30.263440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c3d8d69c0 pid: 124277 (default app) Jul 19 20:53:30.565388 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 20:53:30.571620 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: WARNING keystonemiddleware.auth_token [None req-4e2c1af7-e353-4400-aced-434ff07fc656 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 20:53:30.578419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c3d8d69c0 pid: 124278 (default app) Jul 19 20:54:17.528305 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.529420 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.530138 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.530860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.814028 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.815562 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.816876 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:17.817952 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:20.026359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-75b34101-ddce-4ade-a2ba-4ea0926e89c6 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Action: 'create', calling method: .version_select at 0x7f12654bcc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1352158449"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:20.092415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a98672b7-b26d-4d2a-9d54-dcd4a859dda0 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Action: 'create', calling method: .version_select at 0x7f12654bec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1364954287", "metadata": {"Type": "work"}}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:22.237015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-75b34101-ddce-4ade-a2ba-4ea0926e89c6 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.718548 Jul 19 20:54:22.238387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1154 bytes} [Tue Jul 19 20:54:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4724 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 20:54:22.267677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9e39ba0a-b6da-47a7-b4e3-5383936f95d7 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f1265380a60>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:22.425006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a98672b7-b26d-4d2a-9d54-dcd4a859dda0 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.628731 Jul 19 20:54:22.426316 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 1/2] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jul 19 20:54:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4634 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 19 20:54:22.431892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-49d13bfd-471f-4832-85b7-d836b262f9fe tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126538ba60>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:22.531386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9e39ba0a-b6da-47a7-b4e3-5383936f95d7 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/2152f35d-16ac-4f04-8a1f-6f432225008f" status: 200 len: 351 microversion: 2.1 time: 0.290039 Jul 19 20:54:22.532317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 2/3] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:22 2022] GET /compute/v2.1/os-volumes/2152f35d-16ac-4f04-8a1f-6f432225008f => generated 351 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:22.553912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5fa89495-6218-46e7-84a9-a6a6aafe7ab2 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f1265380b80>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:22.605537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-49d13bfd-471f-4832-85b7-d836b262f9fe tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c" status: 200 len: 346 microversion: 2.1 time: 0.175369 Jul 19 20:54:22.612190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 2/4] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:22 2022] GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c => generated 346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:22.620202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d46c1c9e-7cab-4a9e-9888-12cfbdfce431 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Action: 'create', calling method: .version_select at 0x7f126538bb80>, body: {"snapshot": {"volume_id": "20061e35-4365-42af-8d16-df14261cfb8c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-667229934"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:22.745053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5fa89495-6218-46e7-84a9-a6a6aafe7ab2 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.209834 Jul 19 20:54:22.747916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 3/5] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:22 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:23.614067 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d46c1c9e-7cab-4a9e-9888-12cfbdfce431 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.000950 Jul 19 20:54:23.622035 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 3/6] 10.222.0.85 () {60 vars in 1161 bytes} [Tue Jul 19 20:54:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:23.632024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e9fb6e03-5855-4f26-9377-e97b349fcfb4 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f12653a4310>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:23.762696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-db8a5e17-396d-42d7-8d8e-ab97d5e6a147 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f126539c820>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:23.812636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e9fb6e03-5855-4f26-9377-e97b349fcfb4 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.187600 Jul 19 20:54:23.813888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 4/7] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:23 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:23.826531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-825957f2-6618-4cf2-a8ff-4f0301d150c9 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f12653a49d0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:23.911609 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-825957f2-6618-4cf2-a8ff-4f0301d150c9 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.088818 Jul 19 20:54:23.912817 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 5/8] 10.222.0.85 () {58 vars in 1139 bytes} [Tue Jul 19 20:54:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:23.933534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3f8cee0f-2fc9-4596-81d7-a20fce8d5b8b tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f12653a4d30>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:23.959368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-db8a5e17-396d-42d7-8d8e-ab97d5e6a147 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 354 microversion: 2.1 time: 0.201120 Jul 19 20:54:23.961065 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 4/9] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:23 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:23.977204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3d669a91-ef13-4450-9416-8a03ff20d2ec tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f126539cee0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:24.006041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3f8cee0f-2fc9-4596-81d7-a20fce8d5b8b tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.083616 Jul 19 20:54:24.009108 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 6/10] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:23 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:24.145583 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3d669a91-ef13-4450-9416-8a03ff20d2ec tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 354 microversion: 2.1 time: 0.172483 Jul 19 20:54:24.146152 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 5/11] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:23 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:24.176840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5d9814e2-6460-4404-a1db-f150fb179706 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f12653a44c0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:24.302440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5d9814e2-6460-4404-a1db-f150fb179706 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 202 len: 0 microversion: 2.1 time: 0.129696 Jul 19 20:54:24.302957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 7/12] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 20:54:24 2022] DELETE /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:54:24.317718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-75c334f2-5b08-4dd9-ada5-0407a191d256 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f126539cd30>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:24.459845 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-75c334f2-5b08-4dd9-ada5-0407a191d256 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.150419 Jul 19 20:54:24.460786 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 6/13] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:24 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:24.782318 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f6ef19cd-66fb-4be0-af30-294c4ef434b5 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f1265380c10>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:25.000849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f6ef19cd-66fb-4be0-af30-294c4ef434b5 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/b2eb6a97-bc5d-467a-acac-63bf7f21900d" status: 200 len: 351 microversion: 2.1 time: 0.222471 Jul 19 20:54:25.012171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 8/14] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:24 2022] GET /compute/v2.1/os-volumes/b2eb6a97-bc5d-467a-acac-63bf7f21900d => generated 351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:25.035923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-306d270e-9dd5-4643-b3d0-5f55838c6d04 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126539c670>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:25.383812 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-306d270e-9dd5-4643-b3d0-5f55838c6d04 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.367435 Jul 19 20:54:25.385525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 7/15] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:25 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:25.484772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-47892b8a-c47a-4310-8ec1-2d9f1dd94be5 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f12653a40d0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:25.729314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-47892b8a-c47a-4310-8ec1-2d9f1dd94be5 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.253882 Jul 19 20:54:25.740515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 9/16] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:25 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:26.407063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3f90fb51-6897-4b81-a797-c4842dd5c70b tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126538b820>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:26.571897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3f90fb51-6897-4b81-a797-c4842dd5c70b tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.177524 Jul 19 20:54:26.572671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 8/17] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:26 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:26.751186 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4a6f7c81-cc60-4aa9-a064-668456e56e31 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f12653a4ca0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:26.902698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4a6f7c81-cc60-4aa9-a064-668456e56e31 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.156757 Jul 19 20:54:26.902698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 10/18] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:26 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:27.583740 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8dda3a56-7ad4-4e22-9345-6aa3353fe698 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126538bb80>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:27.636949 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8dda3a56-7ad4-4e22-9345-6aa3353fe698 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.057456 Jul 19 20:54:27.638069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 9/19] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:27 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:27.917113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-980031e8-0d39-49dc-948b-148a562dc4b0 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f1265380f70>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:28.067838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-980031e8-0d39-49dc-948b-148a562dc4b0 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.155008 Jul 19 20:54:28.070188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 11/20] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:27 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:28.655464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bdc48e12-d28d-475f-8292-e47e546255b9 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126539c280>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:28.769442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bdc48e12-d28d-475f-8292-e47e546255b9 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.121719 Jul 19 20:54:28.776364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 10/21] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:28 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:29.093862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7db0e4a3-f87a-4ce9-9fc3-e8dd1784a765 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f12653b2160>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:29.250441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7db0e4a3-f87a-4ce9-9fc3-e8dd1784a765 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.170864 Jul 19 20:54:29.252260 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 12/22] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:29 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:29.790633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e7d9c62c-3597-40d4-a054-b39b2c1a674a tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126539ca60>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:29.920261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e7d9c62c-3597-40d4-a054-b39b2c1a674a tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.139909 Jul 19 20:54:29.923847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 11/23] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:29 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:30.278044 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a502f235-921a-4bf1-90d4-cee381ddb029 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f1265380b80>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:30.399590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a502f235-921a-4bf1-90d4-cee381ddb029 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.135392 Jul 19 20:54:30.401095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 13/24] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:30 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:30.953026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-98c487fa-6d43-4971-ae5f-42cbcb92e94e tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f12653b01f0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:31.109138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-98c487fa-6d43-4971-ae5f-42cbcb92e94e tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 287 microversion: 2.1 time: 0.178061 Jul 19 20:54:31.110081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 12/25] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:30 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:31.154721 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-798f3965-7903-4342-8618-749d7f7e4259 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126539cb80>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:31.403354 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-798f3965-7903-4342-8618-749d7f7e4259 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 202 len: 0 microversion: 2.1 time: 0.277708 Jul 19 20:54:31.404771 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 13/26] 10.222.0.85 () {58 vars in 1253 bytes} [Tue Jul 19 20:54:31 2022] DELETE /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:31.434226 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-18f6a524-6c19-43fa-ad1b-46cbb4316a9e tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f126539c5e0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:31.442040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6157b823-dc0d-4a4d-903a-cf3cda38aa5a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: .version_select at 0x7f12653a4ee0>, body: {"keypair": {"name": "tempest-keypair-553711808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAoKTeq11NfO3FfN0RX3Ii4kR8iLKldbaf/xaKxqMJgU+3Hu4b0bbZhUZVTmYJIVUFoIDwxX4qj3+xSq0Z3pOfyBlXFZk9yw23fHacYSZcriALg3DvIpyYCqrU5TqW9xw=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:31.607386 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-18f6a524-6c19-43fa-ad1b-46cbb4316a9e tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 200 len: 353 microversion: 2.1 time: 0.197718 Jul 19 20:54:31.608527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 14/27] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:31 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:31.615710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-23b04a45-b031-4d6a-a8bb-24be0c0c1525 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126538bc10>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:31.702470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-6157b823-dc0d-4a4d-903a-cf3cda38aa5a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:31.715710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-23b04a45-b031-4d6a-a8bb-24be0c0c1525 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 200 len: 286 microversion: 2.1 time: 0.105994 Jul 19 20:54:31.716670 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 15/28] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:31 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:31.740927 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-6157b823-dc0d-4a4d-903a-cf3cda38aa5a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:31.924975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6157b823-dc0d-4a4d-903a-cf3cda38aa5a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.834889 Jul 19 20:54:31.931447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 14/29] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 20:54:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:54:31.977254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4177e556-d1d3-4716-bd5d-ac4d41029a65 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f12653b0310>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.078069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4177e556-d1d3-4716-bd5d-ac4d41029a65 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e095608d-2b46-446e-9249-5793f02ab6b8" status: 200 len: 350 microversion: 2.1 time: 0.104700 Jul 19 20:54:32.079251 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 16/30] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:31 2022] GET /compute/v2.1/os-volumes/e095608d-2b46-446e-9249-5793f02ab6b8 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:32.093419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-99d2a1bb-f106-4b35-92d3-048306bab333 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f12652f78b0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.380982 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-99d2a1bb-f106-4b35-92d3-048306bab333 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.293076 Jul 19 20:54:32.381900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 15/31] 10.222.0.85 () {58 vars in 1133 bytes} [Tue Jul 19 20:54:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:32.400468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-48b7defd-7e55-4730-ad6e-8319b520bf8a tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f126539c430>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.628584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a6f9a5d-e751-462d-becb-d869bb48e8c3 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Calling method '.version_select at 0x7f126532ec10>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.758011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-8a6f9a5d-e751-462d-becb-d869bb48e8c3 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] HTTP exception thrown: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a6f9a5d-e751-462d-becb-d869bb48e8c3 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Request method failure captured: Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 HTTP/1.1 Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xn5_8pnIFqES9Ct-xk69RtzuwTCu1rmbJcLnHmd-h4fveEKx17sqjStXIgln7rLkoLVfVCdTcaKg3W5ctFHZNwMRPm1LhySPIQgz9mVxCnxiVa6YOVbggUGAYTdzHHOUOIK9MrE-7D7kCXsXgZJgfh3LTR0EEE0ec45jbqClWlyovc Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: bc43a6a797fa4550be7d6e12c7a52ad7 Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesGetTestJSON-203848254 Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:54:32.763561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc43a6a797fa4550be7d6e12c7a52ad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc43a6a797fa4550be7d6e12c7a52ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc43a6a797fa4550be7d6e12c7a52ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc43a6a797fa4550be7d6e12c7a52ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesGetTestJSON-203848254 Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: bc43a6a797fa4550be7d6e12c7a52ad7 Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesGetTestJSON-203848254 Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesGetTestJSON-203848254-project Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 844287bfecbf4527a8332b6527235e3f Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesGetTestJSON-203848254-project Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '5302bef2-222a-4aa5-82ff-324dc5d60ed1'} Jul 19 20:54:32.764952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. (HTTP 404) (Request-ID: req-f957dd59-7522-4a2a-a0f0-044b962eb4a6) Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:32.765731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:32.767102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:54:32.768187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.769562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a6f9a5d-e751-462d-becb-d869bb48e8c3 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] Returning 404 to user: Volume 5302bef2-222a-4aa5-82ff-324dc5d60ed1 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:32.777584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a6f9a5d-e751-462d-becb-d869bb48e8c3 tempest-VolumesGetTestJSON-203848254 tempest-VolumesGetTestJSON-203848254-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1" status: 404 len: 109 microversion: 2.1 time: 0.153539 Jul 19 20:54:32.777584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 16/32] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:32 2022] GET /compute/v2.1/os-volumes/5302bef2-222a-4aa5-82ff-324dc5d60ed1 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:54:32.783497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d7416f3-08e5-42a8-a4e9-4a030a6cc264 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f1264ab4430>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.797514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-48b7defd-7e55-4730-ad6e-8319b520bf8a tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.405697 Jul 19 20:54:32.799699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 17/33] 10.222.0.85 () {58 vars in 1148 bytes} [Tue Jul 19 20:54:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:32.821819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aba194f1-9e78-4852-9bb4-27daaecc5654 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f126539ce50>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:32.838863 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-0d7416f3-08e5-42a8-a4e9-4a030a6cc264 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] HTTP exception thrown: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d7416f3-08e5-42a8-a4e9-4a030a6cc264 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Request method failure captured: Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 HTTP/1.1 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xn5u0utYaHEjPR7xyOnofOyLGf2koVvvAgaoyp31yhg_ozyxOcRCrCadWzpJ8rUCJAK3Lb9JnBp4apAaeSCkUWB18Mq8fzLwPtmv5n0AjfHXMlMkGnSVvAk4Q6Nsnw5LORSy8NAfjXVpmD_QtshSwXXqnZhzbMlTtMnxdD5yjOkOL0 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:54:32.842212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: c15bdb27a3be441d8e2a9812d50307e4 Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'bd0179ff-e157-4542-a5e5-3c04fe455525'} Jul 19 20:54:32.843436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. (HTTP 404) (Request-ID: req-b04665e7-5ee3-4ac9-b684-939cf1aeca3e) Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.844183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:32.845140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 20:54:32.846051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. Jul 19 20:54:32.847058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:32.848094 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d7416f3-08e5-42a8-a4e9-4a030a6cc264 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Returning 404 to user: Snapshot bd0179ff-e157-4542-a5e5-3c04fe455525 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:32.849112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d7416f3-08e5-42a8-a4e9-4a030a6cc264 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525" status: 404 len: 111 microversion: 2.1 time: 0.070218 Jul 19 20:54:32.850117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 17/34] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 20:54:32 2022] GET /compute/v2.1/os-snapshots/bd0179ff-e157-4542-a5e5-3c04fe455525 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:54:32.864236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-69ed85f2-bcca-4319-b6bd-236735783bab tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f126532ed30>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:33.114653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-69ed85f2-bcca-4319-b6bd-236735783bab tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c" status: 202 len: 0 microversion: 2.1 time: 0.258238 Jul 19 20:54:33.115784 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 18/35] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 20:54:32 2022] DELETE /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:54:33.121366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-aba194f1-9e78-4852-9bb4-27daaecc5654 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.312531 Jul 19 20:54:33.122828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 18/36] 10.222.0.85 () {58 vars in 1133 bytes} [Tue Jul 19 20:54:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:33.130264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fbd8de9e-5380-43b9-a1d2-5161f615717f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f1264ab41f0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:33.135161 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f448fbf2-247f-44f7-89d2-5ce50580c54e tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f12653b0280>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:33.382557 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fbd8de9e-5380-43b9-a1d2-5161f615717f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c" status: 200 len: 345 microversion: 2.1 time: 0.256843 Jul 19 20:54:33.383956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 19/37] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:33 2022] GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c => generated 345 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:33.428958 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f448fbf2-247f-44f7-89d2-5ce50580c54e tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.297687 Jul 19 20:54:33.441065 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 19/38] 10.222.0.85 () {58 vars in 1166 bytes} [Tue Jul 19 20:54:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:33.449813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0ed8a092-7670-4b4f-871e-cfb2261cc04f tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f1264a9f310>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:33.791188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0ed8a092-7670-4b4f-871e-cfb2261cc04f tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.347917 Jul 19 20:54:33.798984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 20/39] 10.222.0.85 () {58 vars in 1169 bytes} [Tue Jul 19 20:54:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:33.838411 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c6509ed6-c2cf-4727-a645-0e991f3674c0 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f126538bee0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.051877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c6509ed6-c2cf-4727-a645-0e991f3674c0 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.247912 Jul 19 20:54:34.059024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 20/40] 10.222.0.85 () {58 vars in 1154 bytes} [Tue Jul 19 20:54:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:34.069449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-32f63234-2ff6-424a-b971-d758a4191ca7 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f1264a9ff70>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.344612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-32f63234-2ff6-424a-b971-d758a4191ca7 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.282730 Jul 19 20:54:34.352176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 21/41] 10.222.0.85 () {58 vars in 1187 bytes} [Tue Jul 19 20:54:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:54:34.363637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d35aff2f-b347-4505-b77b-63edd7130fb2 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] Calling method '.version_select at 0x7f126539cd30>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.403386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d926f552-5c13-4666-8e1c-98fc404d7d29 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f1264a9f8b0>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.493057 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-d926f552-5c13-4666-8e1c-98fc404d7d29 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] HTTP exception thrown: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d926f552-5c13-4666-8e1c-98fc404d7d29 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Request method failure captured: Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c HTTP/1.1 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xn5u0utYaHEjPR7xyOnofOyLGf2koVvvAgaoyp31yhg_ozyxOcRCrCadWzpJ8rUCJAK3Lb9JnBp4apAaeSCkUWB18Mq8fzLwPtmv5n0AjfHXMlMkGnSVvAk4Q6Nsnw5LORSy8NAfjXVpmD_QtshSwXXqnZhzbMlTtMnxdD5yjOkOL0 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:54:34.495200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: c15bdb27a3be441d8e2a9812d50307e4 Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '20061e35-4365-42af-8d16-df14261cfb8c'} Jul 19 20:54:34.496489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. (HTTP 404) (Request-ID: req-15d72dd7-f801-4ddd-996d-b41a3d2e0cab) Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.497373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:34.498254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:54:34.499212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.500192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.503562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d926f552-5c13-4666-8e1c-98fc404d7d29 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Returning 404 to user: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:34.505440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d926f552-5c13-4666-8e1c-98fc404d7d29 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c" status: 404 len: 109 microversion: 2.1 time: 0.106197 Jul 19 20:54:34.506194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 22/42] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:34 2022] GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:54:34.535658 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e125aafc-f899-40a4-9896-fcaf163b580f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f1264ab4280>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.633293 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-e125aafc-f899-40a4-9896-fcaf163b580f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] HTTP exception thrown: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e125aafc-f899-40a4-9896-fcaf163b580f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Request method failure captured: Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: DELETE /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c HTTP/1.1 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xn5u0utYaHEjPR7xyOnofOyLGf2koVvvAgaoyp31yhg_ozyxOcRCrCadWzpJ8rUCJAK3Lb9JnBp4apAaeSCkUWB18Mq8fzLwPtmv5n0AjfHXMlMkGnSVvAk4Q6Nsnw5LORSy8NAfjXVpmD_QtshSwXXqnZhzbMlTtMnxdD5yjOkOL0 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:54:34.636468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: c15bdb27a3be441d8e2a9812d50307e4 Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '20061e35-4365-42af-8d16-df14261cfb8c'} Jul 19 20:54:34.638586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. (HTTP 404) (Request-ID: req-9116adce-437d-4caa-8d9f-b926a903f316) Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.639913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 20:54:34.643706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 20:54:34.645710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e125aafc-f899-40a4-9896-fcaf163b580f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Returning 404 to user: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e125aafc-f899-40a4-9896-fcaf163b580f tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c" status: 404 len: 109 microversion: 2.1 time: 0.112046 Jul 19 20:54:34.650451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 23/43] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 20:54:34 2022] DELETE /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:54:34.670179 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1c93fa58-00cf-49ec-a009-99497a38ba22 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Calling method '.version_select at 0x7f1264a9f820>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:34.714587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d35aff2f-b347-4505-b77b-63edd7130fb2 tempest-VolumesTestJSON-701231745 tempest-VolumesTestJSON-701231745-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.360275 Jul 19 20:54:34.724962 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 21/44] 10.222.0.85 () {58 vars in 1154 bytes} [Tue Jul 19 20:54:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-1c93fa58-00cf-49ec-a009-99497a38ba22 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] HTTP exception thrown: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1c93fa58-00cf-49ec-a009-99497a38ba22 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Request method failure captured: Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c HTTP/1.1 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xn5u0utYaHEjPR7xyOnofOyLGf2koVvvAgaoyp31yhg_ozyxOcRCrCadWzpJ8rUCJAK3Lb9JnBp4apAaeSCkUWB18Mq8fzLwPtmv5n0AjfHXMlMkGnSVvAk4Q6Nsnw5LORSy8NAfjXVpmD_QtshSwXXqnZhzbMlTtMnxdD5yjOkOL0 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:54:34.725248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_dbff21a960e44c75be1cb0f63a5c6a15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: dbff21a960e44c75be1cb0f63a5c6a15 Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-582544712 Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: c15bdb27a3be441d8e2a9812d50307e4 Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-582544712-project Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '20061e35-4365-42af-8d16-df14261cfb8c'} Jul 19 20:54:34.726457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. (HTTP 404) (Request-ID: req-f13d1755-2883-48ea-bddc-32cc4d3abff4) Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.727091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 20:54:34.728725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 20:54:34.729750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1c93fa58-00cf-49ec-a009-99497a38ba22 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] Returning 404 to user: Volume 20061e35-4365-42af-8d16-df14261cfb8c could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1c93fa58-00cf-49ec-a009-99497a38ba22 tempest-VolumesSnapshotsTestJSON-582544712 tempest-VolumesSnapshotsTestJSON-582544712-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c" status: 404 len: 109 microversion: 2.1 time: 0.077937 Jul 19 20:54:34.730716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 24/45] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 20:54:34 2022] GET /compute/v2.1/os-volumes/20061e35-4365-42af-8d16-df14261cfb8c => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:54:38.118606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-da98810c-5157-49af-8132-da086fdc818f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'create', calling method: .version_select at 0x7f12653b09d0>, body: {"keypair": {"name": "tempest-keypair-848711117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMR6AfzPfKIfFA0+smmtrCGRc71R22ae0p0Xy6nNWyEQhJ75At0JuIEM0hKWTwePvTdEwlahN8M+SK9bHMGKZBVP9/9AKdq2NOL/AkBQiEFogmHykq90uCv6oeDmDTcgg=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:38.336435 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-da98810c-5157-49af-8132-da086fdc818f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:38.399363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-da98810c-5157-49af-8132-da086fdc818f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for user 1f026e791bf24a9fab1aaedb794e6229 and project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:38.544070 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-da98810c-5157-49af-8132-da086fdc818f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.000721 Jul 19 20:54:38.554620 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 22/46] 10.222.0.85 () {62 vars in 1199 bytes} [Tue Jul 19 20:54:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1014 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 19 20:54:41.694801 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-66479203", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "networks": [{"uuid": "56c50a48-7016-495e-a47d-04c6302f5db4"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:41.707632 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1071630122", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96395a07-97fe-40fb-bf6f-dcb0f6511ee1"}], "security_groups": [{"name": "tempest-securitygroup--678246963"}], "key_name": "tempest-keypair-553711808", "user_data": "}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:41.882190 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:42.046977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] validate_networks() for [('56c50a48-7016-495e-a47d-04c6302f5db4', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:54:42.811201 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] validate_networks() for [('96395a07-97fe-40fb-bf6f-dcb0f6511ee1', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:54:45.683212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:54:45.684004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:54:45.684437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:54:45.684985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:54:45.685581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:54:45.716893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:45.721603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:45.724473 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:45.726483 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:45.810297 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Getting quotas for project 79723635097c40588d8dfedceb79ee68. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:45.819885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Getting quotas for user 284d7172360641a6b039d1bc23e1152e and project 79723635097c40588d8dfedceb79ee68. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:45.842631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:54:45.847309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:54:45.987483 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b0c60261-4524-40c0-b43d-b6e716c8a178 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.444696 Jul 19 20:54:45.991418 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 25/47] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:54:46.012953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1737265327", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94f06112-ed58-4b53-af27-58837f61b880"}], "security_groups": [{"name": "tempest-securitygroup--1340006292"}], "key_name": "tempest-keypair-848711117", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:54:46.178776 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:54:46.179604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:54:46.181248 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:54:46.182264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:54:46.183672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:54:46.226247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.227809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.235137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:46.236368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:46.386588 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:46.397262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:46.430703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:54:46.440821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:54:46.479158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] validate_networks() for [('94f06112-ed58-4b53-af27-58837f61b880', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:54:46.778414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ea85057a-41a1-4d41-a5da-4b7e91920f3f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.099462 Jul 19 20:54:46.784615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 23/48] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:54:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 5103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:54:46.797335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-47eb6c11-7a32-4bc8-acbb-b1fe9197ced9 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:46.804127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-47eb6c11-7a32-4bc8-acbb-b1fe9197ced9 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:47.465928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-47eb6c11-7a32-4bc8-acbb-b1fe9197ced9 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:47.504291 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-47eb6c11-7a32-4bc8-acbb-b1fe9197ced9 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1213 microversion: 2.1 time: 0.720529 Jul 19 20:54:47.506760 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 24/49] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:46 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1213 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:47.520585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2019ba40-3696-4d39-8407-c3d6034e8885 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:47.524242 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2019ba40-3696-4d39-8407-c3d6034e8885 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:47.733183 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2019ba40-3696-4d39-8407-c3d6034e8885 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:47.756459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2019ba40-3696-4d39-8407-c3d6034e8885 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1241 microversion: 2.1 time: 0.244978 Jul 19 20:54:47.758092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 25/50] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:47 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1241 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:48.539199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e6eea3c7-2195-4379-866f-ec0edf6e3cf0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:48.542855 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e6eea3c7-2195-4379-866f-ec0edf6e3cf0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:48.744591 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e6eea3c7-2195-4379-866f-ec0edf6e3cf0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:48.772794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e6eea3c7-2195-4379-866f-ec0edf6e3cf0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1213 microversion: 2.1 time: 0.238321 Jul 19 20:54:48.776063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 26/51] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:48 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:48.802203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a5bb013-88a2-451f-add5-81c2f28b4873 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:48.803708 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7a5bb013-88a2-451f-add5-81c2f28b4873 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:49.314025 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7a5bb013-88a2-451f-add5-81c2f28b4873 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:49.327225 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a5bb013-88a2-451f-add5-81c2f28b4873 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1241 microversion: 2.1 time: 0.543878 Jul 19 20:54:49.333922 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 27/52] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:48 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1241 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:49.736599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:54:49.737878 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:54:49.738649 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:54:49.739280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:54:49.740030 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:54:49.773206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.774661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.777774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.778231 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.813989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:49.818336 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:49.850763 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:54:49.852125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.855313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.862111 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:49.863445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:49.864316 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for user 1f026e791bf24a9fab1aaedb794e6229 and project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:54:49.940897 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:54:49.960510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:54:50.099432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1cb7dc2d-3596-4125-8f68-19cbe695a578 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.102171 Jul 19 20:54:50.100910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 26/53] 10.222.0.85 () {62 vars in 1187 bytes} [Tue Jul 19 20:54:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 4108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 20:54:50.131455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7d46db54-79c6-4985-8584-a6b24eba836a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:50.132087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7d46db54-79c6-4985-8584-a6b24eba836a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:50.290233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:50.356787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9307b2f2-fda5-4077-a48f-6a772eabb469 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1217 microversion: 2.1 time: 0.553038 Jul 19 20:54:50.379118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 28/54] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:49 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1217 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:50.379758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d46db54-79c6-4985-8584-a6b24eba836a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:50.397604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d46db54-79c6-4985-8584-a6b24eba836a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:50.406718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:50.409021 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:50.410709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d46db54-79c6-4985-8584-a6b24eba836a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:50.411893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7d46db54-79c6-4985-8584-a6b24eba836a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1281 microversion: 2.20 time: 0.298812 Jul 19 20:54:50.422702 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 27/55] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:50 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:54:50.458016 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.459635 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.461685 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:50.465918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:50.726094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:50.741826 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-156d347f-d4ad-43fe-8a87-a187fc4e2b10 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1237 microversion: 2.1 time: 0.359012 Jul 19 20:54:50.750640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 29/56] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:50 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1237 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:51.387083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.387974 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.403011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.408475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.409534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.410868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.431653 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.431653 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.469902 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.470725 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.471581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.472032 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.646890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.682260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.683989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.684267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:51.691893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b668a3f5-2bc8-47c5-961e-806e00b8c3cf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1285 microversion: 2.20 time: 0.263549 Jul 19 20:54:51.713723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 30/57] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:51 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:54:51.743296 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-94d98ef3-8a77-4da7-8f30-b1482fe70eb2 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1265 microversion: 2.1 time: 0.359737 Jul 19 20:54:51.745652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 28/58] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:51 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:51.781889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:51.784157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:51.809500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.809971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:51.810818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:51.811235 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.071257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:52.110163 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-169e4170-d90b-433e-a39a-db4131ae178f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1293 microversion: 2.1 time: 0.339163 Jul 19 20:54:52.113716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 31/59] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:51 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:52.711228 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:52.712578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:52.726442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.727454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.728860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.734581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.788442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:52.792076 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:52.823573 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.824252 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.825586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:52.826351 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:52.874019 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:52.885583 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:52.887145 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:52.897278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f27aaba6-65a2-41c7-a5a8-815e43a84e63 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1333 microversion: 2.20 time: 0.184408 Jul 19 20:54:52.898369 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 29/60] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:52 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1333 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:54:53.133329 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:53.135774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:53.153292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.154810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.159324 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.161468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.315271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:53.326461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2e89d076-ecfc-4344-9889-190985b4c864 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1271 microversion: 2.1 time: 0.544859 Jul 19 20:54:53.332684 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 32/61] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:52 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1271 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:53.404652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:53.435526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7af6c8b4-317a-4330-9b27-0ac11f6ed9da tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1299 microversion: 2.1 time: 0.308755 Jul 19 20:54:53.436159 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 30/62] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:53 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:53.931260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:53.931938 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:53.942309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.942878 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:53.943675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:53.944130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.156026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.172567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.177190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.179197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dedbaa54-522f-4299-8679-07a0575dab39 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1339 microversion: 2.20 time: 0.253211 Jul 19 20:54:54.186098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 33/63] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:53 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1339 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:54:54.354084 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:54.354933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:54.374063 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.374515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.375298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.375779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.454990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:54.456130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:54.464303 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.465504 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.467702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:54.468495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:54.621803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.635241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0a55fa4d-64f0-4e80-8a62-0a8e5b72b273 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1271 microversion: 2.1 time: 0.287710 Jul 19 20:54:54.638561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 31/64] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:54 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1271 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:54.686943 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:54.702177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7dbf1a2c-ff01-422c-b80c-c7fcc7c87bb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1299 microversion: 2.1 time: 0.251257 Jul 19 20:54:54.706125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 34/65] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:54 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:55.205600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:55.206687 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:55.236069 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.237386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.239394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.240248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.577977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:55.600669 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:55.603331 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:55.604891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-717f32cc-3992-4a59-a610-e44f6cdc55db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1339 microversion: 2.20 time: 0.405121 Jul 19 20:54:55.605904 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 32/66] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:55 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1339 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:54:55.655181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:55.663172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:55.680173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.681423 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.683790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.685757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.719680 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:55.720520 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:55.737576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.737937 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:55.740194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:55.740900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.365107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:56.435683 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:56.450412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fc270d2b-8971-4e47-94a4-677ad1629214 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.798952 Jul 19 20:54:56.462343 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 35/67] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:55 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:56.475403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:56.485637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-08faa418-c121-492d-8725-d80b276faf07 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.769994 Jul 19 20:54:56.488177 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 33/68] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:55 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:56.639506 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:56.640318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:56.648602 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.649069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.649871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:56.650383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:56.867480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:56.877218 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:56.878751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:56.879889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5860489d-b9c3-487f-b696-fe0dc95b7bdc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.246584 Jul 19 20:54:56.880910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 36/69] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:56 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:54:57.470054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:57.470885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:57.477307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.477768 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.478551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.478992 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.507491 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:57.508562 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:57.523359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.524617 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.527196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.528813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.863795 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:57.898775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ad37f62d-e850-46e9-87a3-cf235f69d512 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.432743 Jul 19 20:54:57.910101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 34/70] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:57 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:57.931384 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:57.932742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:57.949546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:57.965850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.966655 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.970681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:57.981364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:57.983300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-21f5a1ad-7986-48b7-bd7d-da80a1fcd4e8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.482215 Jul 19 20:54:57.985928 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:57.986103 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 37/71] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:57 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:54:58.365026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:58.380440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:58.384624 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:58.387267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eaf4ec84-40e2-442b-ab89-06f4ef599c17 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.475663 Jul 19 20:54:58.388241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 35/72] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:57 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:54:58.937300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:58.938917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:58.967443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:58.974021 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:58.975567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:58.976566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:58.977161 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.004682 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.006126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.018058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.021775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.024352 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.024963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.321494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=18 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:59.469531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.496879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0bdad885-36de-4656-9c9f-c5ecdae3caf6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.485025 Jul 19 20:54:59.496879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 36/73] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:58 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:59.503921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.511126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:54:59.517322 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d2853610-afdc-483e-b65a-4026d5f4b1f4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.590647 Jul 19 20:54:59.519539 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 38/74] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:54:58 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:54:59.520613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:54:59.527877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.528657 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.529869 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:54:59.530563 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:54:59.767401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.785064 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.787646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:54:59.793055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e531517f-930a-4b23-af3a-31921510b57f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.294796 Jul 19 20:54:59.793811 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 37/75] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:54:59 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:00.503543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.504182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.523486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.527487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.536711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.539129 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.547829 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:00.550794 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:00.554128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:00.558550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=14 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:00.613683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.615093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:00.617283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:00.622524 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.046620 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:01.056295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b92177a2-8ec8-4f2d-83c1-e2855116cc9d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.557470 Jul 19 20:55:01.063940 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 39/76] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:01.069471 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:01.073398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:01.095003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.095456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.096236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:01.096742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:01.995164 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.015796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9455d07b-0e07-458b-abad-cb45566dc74f tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 1.472038 Jul 19 20:55:02.017831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 38/77] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:00 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:02.089537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:02.090173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:02.108291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.108836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.109952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:02.111039 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:02.171570 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.212798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.217246 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.226488 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ff9f84b6-4480-4603-940d-b330184ddad8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 1.158917 Jul 19 20:55:02.240432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 40/78] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:01 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:02.666258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:02.681197 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1d3abef7-36b4-4148-8875-691b71078cc6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.598728 Jul 19 20:55:02.684106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 39/79] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:02 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:03.036604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:03.037683 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:03.056066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.059518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.064088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.066526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.269178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:03.270403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:03.322280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.323140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.324704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.325456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.699879 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:03.725329 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9479c212-abca-4790-a9fa-dc2d2c2099ea tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.690147 Jul 19 20:55:03.729463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 41/80] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:03 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:03.758892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:03.758892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:03.781289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.781970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:03.784269 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:03.785017 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.125689 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:04.135169 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:04.159932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:04.169911 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e6d576b5-baa7-464e-90c8-29204a7591a6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.907946 Jul 19 20:55:04.170582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 40/81] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:03 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:04.593463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-565b2403-e784-4ca7-a14f-709e8698c357 req-98c83ef2-bcc3-4da5-81af-2dddbfa4cb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf6bbdb-013e-482c-8bca-2dbc9d36cd96", "tag": "86466281-274b-49aa-b377-d3bad13d7f7a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:04.609554 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-565b2403-e784-4ca7-a14f-709e8698c357 req-98c83ef2-bcc3-4da5-81af-2dddbfa4cb21 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.612496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-565b2403-e784-4ca7-a14f-709e8698c357 req-98c83ef2-bcc3-4da5-81af-2dddbfa4cb21 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.670686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-565b2403-e784-4ca7-a14f-709e8698c357 req-98c83ef2-bcc3-4da5-81af-2dddbfa4cb21 service nova] Creating event network-changed:86466281-274b-49aa-b377-d3bad13d7f7a for instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 on hv-cinder-74915 Jul 19 20:55:04.671376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-565b2403-e784-4ca7-a14f-709e8698c357 req-98c83ef2-bcc3-4da5-81af-2dddbfa4cb21 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 20:55:04.674087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.675298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.676952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.683158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.718662 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.compute.rpcapi [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 20:55:04.720402 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124277) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 20:55:04.766521 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bf1235c6-9fb1-4e6e-b98a-105e24907ce6 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.418244 Jul 19 20:55:04.767920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 41/82] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:04.774469 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:04.776971 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:04.794725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.795539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:04.796691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:04.797943 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:05.658207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:05.679574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-99969554-5678-4ce1-a9c5-6a78c9e72730 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 1.947360 Jul 19 20:55:05.695424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 42/83] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:03 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:06.097742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-a44a38b8-384a-438d-b9e5-b21fe5312faf req-4f6e9111-0d22-4147-a906-20407fa5a343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef110a-35e6-4bad-8ec1-279639b358c4", "tag": "e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:06.141340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a44a38b8-384a-438d-b9e5-b21fe5312faf req-4f6e9111-0d22-4147-a906-20407fa5a343 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.144064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a44a38b8-384a-438d-b9e5-b21fe5312faf req-4f6e9111-0d22-4147-a906-20407fa5a343 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.150274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.166651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cfdd6b5c-5ac2-4f2a-92e9-d5441fe18995 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 1.395374 Jul 19 20:55:06.171230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 42/84] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:04 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:06.185234 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:06.187530 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:06.220361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.222510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.223945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.225109 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.249614 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a44a38b8-384a-438d-b9e5-b21fe5312faf req-4f6e9111-0d22-4147-a906-20407fa5a343 service nova] Creating event network-changed:e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb for instance 5aef110a-35e6-4bad-8ec1-279639b358c4 on hv-cinder-74915 Jul 19 20:55:06.252147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a44a38b8-384a-438d-b9e5-b21fe5312faf req-4f6e9111-0d22-4147-a906-20407fa5a343 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 20:55:06.261669 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.270018 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.271322 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.274160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.310178 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.compute.rpcapi [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 20:55:06.312847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] Releasing lock "compute-rpcapi-router" {{(pid=124278) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 20:55:06.367627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6bf26b6f-8143-4940-8bef-bead641d958b None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.668844 Jul 19 20:55:06.370099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 43/85] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:06.705804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:06.706722 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:06.736892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.738438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.741051 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.742430 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:06.796406 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:06.817794 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.839668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.847312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:06.855528 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bd1dcf48-c5ce-447d-9c09-d946f7ea2468 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.675338 Jul 19 20:55:06.856301 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 43/86] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:06 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:06.965083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-499923c3-d078-4065-9783-120a0d5d8380 req-a41d7f3c-4a5e-4945-aaa5-fb95fcd498c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:06.985842 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-499923c3-d078-4065-9783-120a0d5d8380 req-a41d7f3c-4a5e-4945-aaa5-fb95fcd498c9 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:06.987781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-499923c3-d078-4065-9783-120a0d5d8380 req-a41d7f3c-4a5e-4945-aaa5-fb95fcd498c9 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.001479 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:07.024654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-499923c3-d078-4065-9783-120a0d5d8380 req-a41d7f3c-4a5e-4945-aaa5-fb95fcd498c9 service nova] Creating event network-changed:be0016f3-966e-4341-aec7-fa313f2a1024 for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 on hv-cinder-74915 Jul 19 20:55:07.041612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-499923c3-d078-4065-9783-120a0d5d8380 req-a41d7f3c-4a5e-4945-aaa5-fb95fcd498c9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080116 Jul 19 20:55:07.043083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 44/87] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:55:07.191836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:07.197395 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:07.226942 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.237241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.246348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.253046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.466455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:07.476050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9d83572d-7b2e-454a-8a27-230671a37e68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.776827 Jul 19 20:55:07.479417 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 44/88] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:06 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:07.886299 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:07.887340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:07.924147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:07.925675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.927348 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.931464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:07.935731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:07.939033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a773543-c503-434f-91eb-3be867e97144 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.752558 Jul 19 20:55:07.940886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 45/89] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:07 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:08.427239 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.436450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.438432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.440003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5dc69ce2-c325-4bf7-b875-f5c042d70a7d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.568332 Jul 19 20:55:08.440445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 45/90] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:07 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:08.495623 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:08.496906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:08.509738 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.510187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:08.511285 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.513723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:08.768239 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:08.782758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dc8c38fc-6776-4cbc-93cd-258353fd21d5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.290042 Jul 19 20:55:08.788706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 46/91] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:08 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:08.972415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:08.973163 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:08.983042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.983790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:08.985905 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:08.986585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.319419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:09.331010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4b783ff5-6ce1-4e0a-a7dd-a56cddb02700 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.363792 Jul 19 20:55:09.331611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 46/92] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:08 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:09.460678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:09.461312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:09.471018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:09.471461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.472235 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:09.476205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.664140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:09.675703 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:09.677404 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:09.678907 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f6b90772-4456-444c-85af-c4c21219f8ab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.222813 Jul 19 20:55:09.690347 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 47/93] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:09 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:09.806658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:09.808009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:09.815153 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:09.815594 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:09.816570 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:09.817147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:10.003214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:10.011710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-214ee911-6e6c-4aac-ac13-42fe79b292dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.209579 Jul 19 20:55:10.012847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 47/94] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:09 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:10.349877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:10.350361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:10.361329 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:10.362278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:10.363377 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:10.364053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:10.561128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:10.571375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3d376ecd-17d7-4b0f-b543-ec589f53afc5 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.226934 Jul 19 20:55:10.582914 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 48/95] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:10 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:10.700542 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:10.701244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:10.710433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:10.711591 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:10.712511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:10.713127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.036083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:11.037301 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:11.047034 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:11.052606 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:11.053076 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.054069 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:11.055454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.056223 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:11.062250 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:11.063554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d2ff9f9f-3fd7-4a76-bff6-d31cde433b47 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.369250 Jul 19 20:55:11.065765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 48/96] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:10 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:11.314007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:11.324537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-088dcad7-5316-4f25-afa8-f9dc0b72665f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.293890 Jul 19 20:55:11.326345 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 49/97] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:11 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:11.597391 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:11.597777 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:11.606661 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:11.607214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.608300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:11.609624 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:11.838871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:11.849492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9163fd6e-f551-4125-bb62-a219380bfcd0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.256863 Jul 19 20:55:11.850168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 49/98] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:11 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:12.084431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:12.085044 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:12.093432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.094361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.095394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.096813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.320887 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:12.331142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:12.332827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:12.334390 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-11daf8fd-97dd-486f-869a-d5991ded8cf1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.255526 Jul 19 20:55:12.335492 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 50/99] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:12 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:12.348097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:12.349192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:12.367983 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.368809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.370462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.371455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.644756 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:12.656118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fe360afb-84a1-46a8-abfd-d79e7a40d376 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.315188 Jul 19 20:55:12.657980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 50/100] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:12 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:12.876026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:12.876891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:12.883480 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.883920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:12.884809 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:12.885237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.070100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.080157 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-825d369f-7194-4e3f-b31a-8b3a394fce1e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.216285 Jul 19 20:55:13.080709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 51/101] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:12 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:13.356287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:13.357497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:13.366787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.367552 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.369319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.370061 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.616934 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.629420 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.631558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:13.633221 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b7fb1091-7a24-49bc-8821-9d5cfdf8275f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.284511 Jul 19 20:55:13.638822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 51/102] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:13 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:13.689479 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:13.690937 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:13.701173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.701635 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:13.704210 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:13.704679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.020843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:14.033209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-59d71a45-6561-4535-bf5c-e95b839d76b7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.348183 Jul 19 20:55:14.035022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 52/103] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:13 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:14.097249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:14.098031 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:14.107282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.109055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.110020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.110475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.369152 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:14.384102 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-194ef594-3ef3-46fb-9fa7-a5ac0c2586cb tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.291038 Jul 19 20:55:14.394737 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 52/104] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:14 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:14.657204 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:14.657827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:14.664450 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.665173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.665951 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:14.666388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:14.711558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:14.825726 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:14.836846 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:14.839248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:14.840672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e17155ae-e0b0-4b5d-aa31-2a4886521d81 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.187983 Jul 19 20:55:14.841350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 53/105] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:14 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:15.052582 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:15.053687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:15.061545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.062444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.064476 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.065077 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.241174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:15.255775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-507067af-81b2-47b9-a638-a774a95be743 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.207967 Jul 19 20:55:15.260738 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 53/106] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:15 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:15.401854 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:15.403290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:15.412220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.413109 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.413898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.414499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.580418 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:15.588704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bfe53c84-5594-4aee-814b-89c2cefb33ef tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.190631 Jul 19 20:55:15.599518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 54/107] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:15 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:15.865302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:15.866214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:15.874099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.874817 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:15.876186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:15.876941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.141555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.152219 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.154421 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.155906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5f02a0ef-f03c-47b1-b2cc-1fb07b7e66db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.300662 Jul 19 20:55:16.157332 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 54/108] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:15 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:16.284658 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:16.285300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:16.294037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.296024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.297616 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.298607 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.609248 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:16.611413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:16.613621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:16.629890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.643972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.645280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:16.647040 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:16.854968 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:16.864729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b0e4e25a-ec00-4c4c-b962-1c5b99eeedec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.594257 Jul 19 20:55:16.875757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 55/109] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:16 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:17.046704 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.058592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4d4d8391-4706-4a87-85dc-8182fdfef547 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.454225 Jul 19 20:55:17.059316 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 55/110] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:16 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:17.175137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:17.176777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:17.183380 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.183840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.184661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.185226 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.339853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.356601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.363497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:17.368931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-feaf2b39-3fd9-4f03-8356-b34cf08d9bad tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.195538 Jul 19 20:55:17.370687 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 56/111] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:17 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:17.882262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:17.883088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:17.889920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.890372 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:17.891923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:17.892397 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.031121 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.039085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fb9850b8-3791-4465-9d3a-d17498496c5c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.160609 Jul 19 20:55:18.039673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 56/112] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:17 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:18.079117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:18.079736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:18.093627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.094608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.095567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.095989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.248934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.258286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f9fb1c40-9008-436b-99ea-659397465d90 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.185916 Jul 19 20:55:18.258973 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 57/113] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:18 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:18.387402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:18.388963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:18.395703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.396148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.397188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:18.397395 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:18.533995 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.541989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.543676 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:18.544818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-01ed70db-872b-4948-8bdc-66923efdb236 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.161359 Jul 19 20:55:18.545383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 57/114] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:18 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:19.058121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:19.059753 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:19.067073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.067547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.068430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.068920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.263638 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:19.276147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:19.277046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:19.286842 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a094d75c-2856-423f-94e9-c36765cad339 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.231827 Jul 19 20:55:19.287289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.288160 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 58/115] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:19 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:19.288658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.291059 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.299844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.445915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:19.453951 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-96f27ffc-0d9c-4cd2-8b13-dd62d073ca71 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.182216 Jul 19 20:55:19.454521 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 58/116] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:19 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:19.564240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:19.565092 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:19.571370 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.571802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.572605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:19.573028 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:19.709982 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:19.719033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:19.720215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:19.721337 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e013881e-b92c-488e-81c0-5b0f6455dc48 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.162217 Jul 19 20:55:19.727747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 59/117] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:19 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:20.312413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:20.313641 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:20.320367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:20.320804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.321575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:20.322005 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.455358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.462805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1cc32a2f-be36-4671-bb84-e5b4fb7fb6cd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.154165 Jul 19 20:55:20.463399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 59/118] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:20 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:20.470820 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:20.472026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:20.478504 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:20.478944 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.479706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:20.480131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.613717 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.621821 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0863ef8e-8182-47bd-b569-05e5850f2f2e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.154750 Jul 19 20:55:20.622618 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 60/119] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:20 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:20.739630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:20.740146 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:20.747314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:20.747767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.748586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:20.749019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:20.893077 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.902138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.903807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:20.905035 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-937df91d-e668-40a7-8c59-53a8ab4f9519 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.169387 Jul 19 20:55:20.905617 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 60/120] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:20 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:21.480022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:21.480599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:21.487284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.487726 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.488527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.488988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.506782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:21.628664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:21.636130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e193c52a-a08e-4944-8e5d-f65b3822fbc2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.159995 Jul 19 20:55:21.636717 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 61/121] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:21 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:21.639022 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:21.639631 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:21.645713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.646167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.647049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.647495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.651736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:21.792172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:21.799837 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0adbd4c7-b2de-43cd-be97-c89425947f7e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.164708 Jul 19 20:55:21.800636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 61/122] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:21 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:21.927130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:21.927130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:21.930673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.931120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:21.931896 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:21.932348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.062743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.071109 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.072635 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.073752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ab5b9047-7714-446d-a9d9-215b80499ea1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.154652 Jul 19 20:55:22.074325 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 62/123] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:21 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:22.653073 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:22.653593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:22.659610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.660043 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.660824 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.661249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.794277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.802393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a4155b6f-0ef7-40a8-acc8-ef14ac3eedd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.153181 Jul 19 20:55:22.802956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 62/124] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:22 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:22.817121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:22.817730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:22.823845 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.824292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.825140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:22.825576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:22.964301 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:22.972288 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dd119607-62bc-4bda-8739-6c832f73c4c4 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.160079 Jul 19 20:55:22.972867 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 63/125] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:22 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:23.092576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:23.093197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:23.099751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.100196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.100997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.101431 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.235611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:23.243794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:23.245339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:23.246443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-17dc5493-a8ec-405c-abd9-06a5c17b1dd5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.157903 Jul 19 20:55:23.247014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 63/126] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:23 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:23.805928 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-9dbd049c-881c-4ae2-a0a6-b64d682b136e req-211460b3-668b-4e20-af88-88e47bf28960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aef110a-35e6-4bad-8ec1-279639b358c4", "name": "network-vif-plugged", "status": "completed", "tag": "e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:23.817949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9dbd049c-881c-4ae2-a0a6-b64d682b136e req-211460b3-668b-4e20-af88-88e47bf28960 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.818849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9dbd049c-881c-4ae2-a0a6-b64d682b136e req-211460b3-668b-4e20-af88-88e47bf28960 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.821562 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:23.823002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:23.832047 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.832717 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-9dbd049c-881c-4ae2-a0a6-b64d682b136e req-211460b3-668b-4e20-af88-88e47bf28960 service nova] Creating event network-vif-plugged:e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb for instance 5aef110a-35e6-4bad-8ec1-279639b358c4 on hv-cinder-74915 Jul 19 20:55:23.832833 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.833911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:23.835052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:23.839829 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-9dbd049c-881c-4ae2-a0a6-b64d682b136e req-211460b3-668b-4e20-af88-88e47bf28960 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103073 Jul 19 20:55:23.842481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 64/127] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:23.964995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1337906508", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "networks": [{"uuid": "e63e1644-ba97-43a9-9fed-216082e4300b"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:23.991044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.002893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4e9a61a5-c268-4af7-a5cd-12d0869642af tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.185881 Jul 19 20:55:24.012039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 64/128] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:23 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:24.019459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:24.019662 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:24.026833 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.027013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.027686 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.028238 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.030380 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] validate_networks() for [('e63e1644-ba97-43a9-9fed-216082e4300b', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:55:24.240691 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.248925 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1173b8c7-3071-4a85-8d0c-0dea3f67a385 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.235320 Jul 19 20:55:24.250056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 65/129] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:24 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:24.264516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:24.265136 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:24.271368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.272029 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.272616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.273052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.491118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.499202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.500733 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.501819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e459ce7-801f-4c9a-9e77-6a2525058397 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.241327 Jul 19 20:55:24.502375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 66/130] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:24 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:24.548251 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:55:24.548710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:55:24.549171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:55:24.549569 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:55:24.549987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:55:24.559831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.560270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.561089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:24.561516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:24.579339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Getting quotas for project 72c814e2b46244db93e801a78763d880. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:55:24.583376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Getting quotas for user 483b27bfe5674a528c29a15a054cc617 and project 72c814e2b46244db93e801a78763d880. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:55:24.596186 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:55:24.598632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:55:24.645960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8d283f0a-9c1f-4069-81f7-23247a0e9c73 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685303 Jul 19 20:55:24.652269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 65/131] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:55:24.658313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3ccd8b34-ba4d-4186-9543-6802896529bf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:24.658928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3ccd8b34-ba4d-4186-9543-6802896529bf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:24.714169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3ccd8b34-ba4d-4186-9543-6802896529bf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:24.722502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3ccd8b34-ba4d-4186-9543-6802896529bf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1219 microversion: 2.1 time: 0.068549 Jul 19 20:55:24.723087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 67/132] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:24 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:25.021791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:25.022733 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:25.029632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.030189 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.031051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.031510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.195464 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.203449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7ed11f1f-cf9c-442d-a6c7-60eb5918c11d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.185522 Jul 19 20:55:25.204039 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 66/133] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:25 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:25.267168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:25.267745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:25.274024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.274464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.275277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.275708 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.409919 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.419366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-06b70d61-36c1-47bb-afd9-51b009d767b0 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.156003 Jul 19 20:55:25.420047 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 68/134] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:25 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:25.520243 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:25.520794 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:25.526961 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.527405 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.528191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.528660 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.660500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.668974 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.670473 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.671574 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a12e3a9a-9825-457b-9cea-d11a9eed848c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.155874 Jul 19 20:55:25.672127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 67/135] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:25 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:25.740492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:25.741099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:25.747216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.747659 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.748459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:25.748896 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:25.812010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:25.819951 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-731ba2fc-9a0b-4767-ba3b-ac4784e6b15c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1223 microversion: 2.1 time: 0.083392 Jul 19 20:55:25.820557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 69/136] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:25 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:26.220500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.221108 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:26.227151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.227593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.228472 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.228905 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.360866 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.369576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b229435f-ebe3-479a-b5f0-7a2a9658e6c5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.152560 Jul 19 20:55:26.370165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 68/137] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:26 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:26.437137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.438449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:26.445824 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.446265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.447056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.447538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.583714 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.591803 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5cb3dbd1-c9ac-4163-9b05-addde321c292 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.158457 Jul 19 20:55:26.592400 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 70/138] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:26 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:26.690166 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.690778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:26.696861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.697305 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.698105 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.698542 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.837376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.838074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:26.838696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:26.845332 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.845780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.846239 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.846550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:26.846982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:26.847755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.848917 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3de624cb-e4e0-4235-83de-cd2fbe8b12c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.163049 Jul 19 20:55:26.849664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 69/139] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:26 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:26.908738 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:26.916348 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7e102db9-6ea4-4898-98a0-688bae2e61f8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1223 microversion: 2.1 time: 0.082322 Jul 19 20:55:26.916935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 71/140] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:26 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:27.386714 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:27.387736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:27.394501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.394948 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.395714 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.396141 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.526274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:27.533651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d9345b48-2c75-4e53-9733-d20e43d0fdc5 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.150770 Jul 19 20:55:27.534205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 70/141] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:27 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:27.608668 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:27.609301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:27.615271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.615739 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.616710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.617141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.752646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:27.760450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0f928f7f-8fa9-43e2-b19a-e5dfb0acec67 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.155622 Jul 19 20:55:27.761044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 72/142] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:27 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:27.872855 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:27.873451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:27.880086 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.880559 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.881320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.881743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.933872 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:27.934479 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:27.941612 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.942046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:27.942809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:27.943235 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.013792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:28.022283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-01233590-2ae1-4dac-8d6f-1a4871585f7a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1223 microversion: 2.1 time: 0.092151 Jul 19 20:55:28.031657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 73/143] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:27 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:28.037351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:28.052100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:28.053829 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:28.063676 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fc3808f0-cc91-4f89-a300-68208b51b047 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.185996 Jul 19 20:55:28.065757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 71/144] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:27 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:28.550675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:28.551188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:28.557249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.557683 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.558439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.558865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.699723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:28.707292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a8e6654-f766-4965-b988-478c7ee58551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.160960 Jul 19 20:55:28.707869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 74/145] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:28 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:28.778053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:28.778653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:28.780622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:28.785992 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.786430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.787191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:28.787612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:28.924994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:28.932448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9a20b651-8ce9-4b67-81b2-fb818a553888 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.158165 Jul 19 20:55:28.933017 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 72/146] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:28 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:29.039343 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:29.040105 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:29.041952 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=76 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:29.047823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.048265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.049046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.049469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.082954 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:29.083571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:29.090300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.090854 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.091623 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.091966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.127980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.144804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c4345d69-4970-48b6-98f6-28e5e825ad00 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1223 microversion: 2.1 time: 0.109168 Jul 19 20:55:29.145392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 75/147] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:29 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:29.225913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.233931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.236076 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.237205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-177ab42c-4641-4216-89a2-5b5e46f76db1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.158094 Jul 19 20:55:29.237763 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 73/148] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:29 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:55:29.726328 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:29.727670 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:29.734145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.734584 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.735368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.735798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.875844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:29.883429 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e9f682cb-521a-4dca-ae49-4c2d85aef406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.161957 Jul 19 20:55:29.883995 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 76/149] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:29 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:29.949908 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:29.950635 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:29.957719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.958095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:29.958896 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:29.959398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.103833 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.112391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-41cc192c-72c9-4165-9a61-47ecc46bd09d tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.166243 Jul 19 20:55:30.112979 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 74/150] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:29 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:30.163922 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:30.164820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:30.177104 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.177805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.178688 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.179119 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.256135 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:30.257146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:30.263824 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.265195 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.265997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.267024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.267682 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.273667 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7c57836c-41f9-415c-908f-3a16a2bea960 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1223 microversion: 2.1 time: 0.114995 Jul 19 20:55:30.274270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 77/151] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:30 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:30.449224 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.459381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.461365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:30.463117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5099dd41-bc89-4925-9867-b347473a7e5a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.210803 Jul 19 20:55:30.473618 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 75/152] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:30 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:30.900158 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:30.901114 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:30.916626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.917202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.917990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:30.918529 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:30.995566 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-44d6af92-8e39-4375-a7d3-439a223b1cb9 req-f71a28d6-f8fe-40e2-b76a-06456e5a5142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "name": "network-vif-plugged", "status": "completed", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:31.010049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-44d6af92-8e39-4375-a7d3-439a223b1cb9 req-f71a28d6-f8fe-40e2-b76a-06456e5a5142 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.011037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-44d6af92-8e39-4375-a7d3-439a223b1cb9 req-f71a28d6-f8fe-40e2-b76a-06456e5a5142 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.030539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-44d6af92-8e39-4375-a7d3-439a223b1cb9 req-f71a28d6-f8fe-40e2-b76a-06456e5a5142 service nova] Creating event network-vif-plugged:be0016f3-966e-4341-aec7-fa313f2a1024 for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 on hv-cinder-74915 Jul 19 20:55:31.038173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-44d6af92-8e39-4375-a7d3-439a223b1cb9 req-f71a28d6-f8fe-40e2-b76a-06456e5a5142 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046201 Jul 19 20:55:31.038715 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 76/153] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:55:31.132026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:31.133244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:31.146492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.146608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.146608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.146608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.146608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.149165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:31.153572 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-aa4a1aa3-d7c5-462e-8b5d-6e75bb9995cb tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.257152 Jul 19 20:55:31.154205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 78/154] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:30 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:31.293586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:31.294231 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:31.305024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.306550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.307337 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.307764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.368598 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.378950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-732503cc-b972-482f-bc11-3910ba850ad1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.252156 Jul 19 20:55:31.379536 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 77/155] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:31 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:31.435995 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.447396 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3503279d-c3e9-4073-87aa-5d0496eb8add tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1223 microversion: 2.1 time: 0.160186 Jul 19 20:55:31.447986 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 79/156] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:31 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:31.483238 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:31.483945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:31.494732 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.506101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.507107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:31.507933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:31.874206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.887947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.890757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:31.892813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-30fe62d4-2c93-491f-b6a9-5a124321c51b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.413936 Jul 19 20:55:31.893929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 78/157] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:31 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:32.171121 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:32.172346 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:32.178636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.179081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.179922 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.180401 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.350424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:32.360320 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-01d586e8-f513-4196-bba7-744ddb1f3d2f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.192956 Jul 19 20:55:32.360987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 80/158] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:32 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:32.397614 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:32.398785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:32.405423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.406603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.407424 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.407847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.465515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:32.466475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:32.478395 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.480857 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.483551 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.485370 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.630399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:32.652091 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-768148d1-ad13-4bc9-9db2-962dfca389be tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1215 microversion: 2.1 time: 0.190670 Jul 19 20:55:32.652972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 81/159] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:32 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:32.694896 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:32.706170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-08cc9579-771c-47a3-86bd-7d783b63d84b tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.312832 Jul 19 20:55:32.706967 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 79/160] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:32 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:32.912424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:32.913216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:32.922614 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.923628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:32.924390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:32.925011 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.079548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.089950 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.092314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.094363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4bfdab72-544b-456d-9249-db9848f5c5b9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.185617 Jul 19 20:55:33.105747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 82/161] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:32 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:33.379603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:33.380908 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:33.396943 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.397414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.398214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.398748 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.403171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:33.679705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:33.680749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:33.690498 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.691823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.692814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.693736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.745045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.756826 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-97524e30-9e95-4c3f-9b9b-68865c706eda tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.382138 Jul 19 20:55:33.757422 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 80/162] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:33 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:33.767504 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:33.774442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:33.789941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.793397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.794838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:33.795294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:33.851297 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.868736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f08e7c5b-ea60-4f11-b739-2a0d6a95ac4b tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1271 microversion: 2.1 time: 0.190229 Jul 19 20:55:33.868736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 83/163] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:33 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:33.989069 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:33.998505 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3e6f4e57-5f65-477b-b1e7-63a5980b292a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.238771 Jul 19 20:55:33.999093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 81/164] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:33 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:34.114267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:34.114414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:34.121148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.121590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.122473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.122905 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.288554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:34.298317 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:34.299803 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:34.301133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0cada6bf-407f-4cd7-baf5-4ba9ed23ab34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.192151 Jul 19 20:55:34.301754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 84/165] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:34 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:34.780414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:34.784440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:34.797415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:34.798599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=6 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:34.801055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.801747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.802989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.804587 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.893192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:34.902007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:34.912647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:34.914307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.914748 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:34.915542 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:34.915971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.056417 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.070853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-504e2100-1c9d-4f47-9a14-9ebb974b36af tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1289 microversion: 2.1 time: 0.193660 Jul 19 20:55:35.083863 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 85/166] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:34 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1289 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:35.095188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:35.096438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:35.106537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.107409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.108407 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.109026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.214720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.244637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4bbbfb65-11cb-4e4f-9869-443390fcdb8b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1366 microversion: 2.1 time: 0.472111 Jul 19 20:55:35.264464 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 82/167] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:34 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:35.270686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-22e5ecf6-7b63-4912-8471-bfd0026184b2 req-23f295f6-124d-4c80-8dc6-e086a8df9c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf6bbdb-013e-482c-8bca-2dbc9d36cd96", "name": "network-vif-plugged", "status": "completed", "tag": "86466281-274b-49aa-b377-d3bad13d7f7a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:35.285523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-22e5ecf6-7b63-4912-8471-bfd0026184b2 req-23f295f6-124d-4c80-8dc6-e086a8df9c97 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.286104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-22e5ecf6-7b63-4912-8471-bfd0026184b2 req-23f295f6-124d-4c80-8dc6-e086a8df9c97 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.306146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-22e5ecf6-7b63-4912-8471-bfd0026184b2 req-23f295f6-124d-4c80-8dc6-e086a8df9c97 service nova] Creating event network-vif-plugged:86466281-274b-49aa-b377-d3bad13d7f7a for instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 on hv-cinder-74915 Jul 19 20:55:35.316173 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-22e5ecf6-7b63-4912-8471-bfd0026184b2 req-23f295f6-124d-4c80-8dc6-e086a8df9c97 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046163 Jul 19 20:55:35.317242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 83/168] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:35.323720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:35.324541 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:35.340004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.340567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.345951 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:35.347295 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:35.382215 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.390377 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-30bc2b52-b0b6-4029-90ef-e23ebd9c6f4e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.304319 Jul 19 20:55:35.392710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 86/169] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:35 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:35.545111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.555214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.556757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:35.557861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5a47125e-c618-4a98-9161-bb04cd1da717 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1407 microversion: 2.20 time: 0.239408 Jul 19 20:55:35.558776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 84/170] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:35 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:36.089449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:36.090791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:36.108567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.110171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.110954 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.111763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.230290 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:36.239087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-aebde3cc-d99e-41a8-b93c-b485a5e3de56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1277 microversion: 2.1 time: 0.153771 Jul 19 20:55:36.240890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 87/171] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:36 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:36.273606 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:36.274775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:36.283602 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.284419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.285850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.286826 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.407888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:36.408969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:36.416084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.416383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.421792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.426408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.936632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:36.947888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4800d120-bca8-4c83-a1ee-3874edb2674a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1555 microversion: 2.1 time: 0.679943 Jul 19 20:55:36.950362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 85/172] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:36 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1555 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:36.961220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:36.965225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:36.975105 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.975828 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.976730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:36.977165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:36.991626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:37.004008 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b45c45c2-885a-4a93-b78e-b6141a70e2c7 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.600505 Jul 19 20:55:37.004727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 88/173] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:36 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:37.010482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:37.011355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:37.018200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:37.018784 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:37.019701 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:37.020205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:37.222243 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e4bdb6da-3cee-474b-97ac-1d90026ba01b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215859 Jul 19 20:55:37.230650 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:37.236813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 89/174] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 20:55:37 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:37.248495 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:37.251188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:37.253228 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9a3cc05f-8769-43c6-9b3f-2b55a95289e4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1599 microversion: 2.20 time: 0.295682 Jul 19 20:55:37.254342 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 86/175] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:55:36 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1599 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:55:37.264307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:37.265720 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:37.279524 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:37.280139 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:37.281728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:37.282837 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:37.285394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:37.286447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:37.297180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:37.297861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:37.299066 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:37.311310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:37.786646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-752054b8-61ff-4c50-8825-0c7f67700f46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.506644 Jul 19 20:55:37.787585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 87/176] 10.222.0.85 () {60 vars in 1315 bytes} [Tue Jul 19 20:55:37 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-interface => generated 285 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:55:38.054933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:38.059156 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:38.099819 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:38.101378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:38.106829 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:38.108988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:38.175178 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:38.210507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7fe4a4fb-37e3-42ef-ac79-e17efe9e3fc8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.954538 Jul 19 20:55:38.215566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 90/177] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:37 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:38.517052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-12efadac-f0dc-40de-964c-d73fa3a0c048 req-480a87c9-8db8-4b45-88f6-5b968bfe1403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b78a6c-835d-428c-a95e-af5086bc78cc", "tag": "d37425cd-697a-4728-84c4-f585013a5e98"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:38.566131 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-12efadac-f0dc-40de-964c-d73fa3a0c048 req-480a87c9-8db8-4b45-88f6-5b968bfe1403 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:38.567315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-12efadac-f0dc-40de-964c-d73fa3a0c048 req-480a87c9-8db8-4b45-88f6-5b968bfe1403 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:38.589558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-12efadac-f0dc-40de-964c-d73fa3a0c048 req-480a87c9-8db8-4b45-88f6-5b968bfe1403 service nova] Creating event network-changed:d37425cd-697a-4728-84c4-f585013a5e98 for instance 07b78a6c-835d-428c-a95e-af5086bc78cc on hv-cinder-74915 Jul 19 20:55:38.597192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-12efadac-f0dc-40de-964c-d73fa3a0c048 req-480a87c9-8db8-4b45-88f6-5b968bfe1403 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091832 Jul 19 20:55:38.598438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 91/178] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:38.810430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:38.818582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6f83fa2f-3b3a-4831-910e-714272cc967c tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1313 microversion: 2.1 time: 0.799649 Jul 19 20:55:38.819654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 88/179] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:38 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:39.243564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:39.244936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:39.251314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:39.251754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:39.252580 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:39.252998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:39.600601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:39.609236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8bc4d63b-f9d0-49a1-ac36-e42d9c9f962d tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.369507 Jul 19 20:55:39.609841 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 92/180] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:39 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:39.835324 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:39.835938 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:39.842883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:39.843216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:39.843987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:39.844441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:40.118031 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:40.139981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-81432d53-1717-45b8-b9bb-5db8e710ae18 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1499 microversion: 2.1 time: 0.305717 Jul 19 20:55:40.139981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 89/181] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:39 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1499 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:40.357940 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-78cd5f4f-d928-4f18-9569-31c69b61cba0 req-6210d072-0b10-4580-bb9f-02ec9f2d0de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aef110a-35e6-4bad-8ec1-279639b358c4", "tag": "e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:40.370432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-78cd5f4f-d928-4f18-9569-31c69b61cba0 req-6210d072-0b10-4580-bb9f-02ec9f2d0de4 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:40.371266 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-78cd5f4f-d928-4f18-9569-31c69b61cba0 req-6210d072-0b10-4580-bb9f-02ec9f2d0de4 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:40.389874 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-78cd5f4f-d928-4f18-9569-31c69b61cba0 req-6210d072-0b10-4580-bb9f-02ec9f2d0de4 service nova] Creating event network-changed:e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb for instance 5aef110a-35e6-4bad-8ec1-279639b358c4 on hv-cinder-74915 Jul 19 20:55:40.402467 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-78cd5f4f-d928-4f18-9569-31c69b61cba0 req-6210d072-0b10-4580-bb9f-02ec9f2d0de4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048446 Jul 19 20:55:40.403408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 93/182] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:40.627260 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:40.627960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:40.634471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:40.635282 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:40.636303 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:40.636958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:40.990505 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:41.002434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1995f679-7920-4efc-8e4e-62e9e1ab7f86 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.379594 Jul 19 20:55:41.003016 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 90/183] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:40 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:42.020383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:42.021066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:42.027915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:42.028365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:42.029135 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:42.029549 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:42.173295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:42.182906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a8027655-50db-41ba-9211-62b778f8d03e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.167325 Jul 19 20:55:42.183617 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 94/184] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:42 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:42.438234 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-31945cbc-716d-48ae-ae8a-f92f944d547f req-dd1b0bc7-46d9-41cb-8982-3ea1ebc69ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:42.446747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-31945cbc-716d-48ae-ae8a-f92f944d547f req-dd1b0bc7-46d9-41cb-8982-3ea1ebc69ed6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:42.447181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-31945cbc-716d-48ae-ae8a-f92f944d547f req-dd1b0bc7-46d9-41cb-8982-3ea1ebc69ed6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:42.458553 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-31945cbc-716d-48ae-ae8a-f92f944d547f req-dd1b0bc7-46d9-41cb-8982-3ea1ebc69ed6 service nova] Creating event network-changed:be0016f3-966e-4341-aec7-fa313f2a1024 for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 on hv-cinder-74915 Jul 19 20:55:42.464356 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-31945cbc-716d-48ae-ae8a-f92f944d547f req-dd1b0bc7-46d9-41cb-8982-3ea1ebc69ed6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029685 Jul 19 20:55:42.464954 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 91/185] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:43.202490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:43.203810 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:43.213209 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:43.213209 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:43.213892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:43.214503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:43.359976 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:43.367621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a36daa5c-634a-4055-a6e4-b1ac97891982 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.169279 Jul 19 20:55:43.368430 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 95/186] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:43 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:44.387284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:44.388796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:44.396026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:44.396759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:44.397536 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:44.397974 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:44.543818 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:44.551913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-029c0e1c-189c-461f-89d1-3567295027e1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.169722 Jul 19 20:55:44.552451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 92/187] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:44 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:44.772639 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb213e46-082e-4523-aa31-b4df94c44c0e"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:55:44.774783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:44.785970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:44.786882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:44.787916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:44.788873 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:45.573879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:45.574935 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:45.585502 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:45.586190 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:45.587528 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:45.588282 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:45.722351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:45.730543 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-db973ea8-d979-475d-83f4-cc0a8790a82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.163499 Jul 19 20:55:45.731985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 93/188] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:45 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:46.748308 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:46.749351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:46.755885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:46.756349 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:46.757128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:46.757562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:46.891074 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:46.898635 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d30c5444-c361-4cee-adf8-401657dc4524 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.154218 Jul 19 20:55:46.899188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 94/189] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:46 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:47.916294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:47.917306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:47.923364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:47.923734 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:47.924564 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:47.924996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:48.070451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:48.077895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fa1aad87-806b-4b63-b256-aad0bc47a0c7 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.165412 Jul 19 20:55:48.078453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 95/190] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:47 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:49.094834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:49.095519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:49.101755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:49.102201 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:49.102976 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:49.103414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:49.247933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:49.255571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-841fb53b-b715-48ae-90c9-c747fc18b6f4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.164634 Jul 19 20:55:49.256140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 96/191] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:49 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:50.272685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:50.273372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:50.279452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:50.279902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:50.280767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:50.281690 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:50.431158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:50.438904 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-71b943a5-42dc-44b4-9284-5b9d96735981 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.170029 Jul 19 20:55:50.439715 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 97/192] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:50 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:51.456498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:51.457190 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:51.463546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:51.464000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:51.464804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:51.465240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:51.485588 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:51.598640 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:51.606134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f3655569-2d6a-4620-b376-d45d6fb92060 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.153693 Jul 19 20:55:51.606699 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 98/193] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:51 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:52.627322 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:52.628381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:52.638270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:52.638984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:52.640219 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:52.640985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:52.792697 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:52.800915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3c84b76a-c086-4a85-b8d0-44dc70c8e05c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.180890 Jul 19 20:55:52.801517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 99/194] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:52 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:53.817957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:53.818596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:53.824855 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:53.825292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:53.826079 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:53.826488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:53.964911 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:53.972389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5167ecd6-b18c-4a1e-a1ed-88b8f4d9badd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.158416 Jul 19 20:55:53.972953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 100/195] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:53 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:54.786897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=43 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:54.872383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=98 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:54.989875 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:54.990558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:54.996666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:54.997040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:54.997808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:54.998241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:55.131168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:55.138560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bfb27ae1-ea16-4024-8fce-111fcaa45b21 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.152593 Jul 19 20:55:55.139112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 101/196] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:54 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:56.164749 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:56.165414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:56.172825 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:56.173348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:56.174343 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:56.174829 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:56.350254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:56.362804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9ee854ea-7e12-4396-8c65-51fff0669413 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.205848 Jul 19 20:55:56.362804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 102/197] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:56 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:55:57.028303 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8f42479c-0a68-4fb0-aa67-4ff3d23e75b3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "POST /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.266623 Jul 19 20:55:57.035982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 96/198] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 20:55:44 2022] POST /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96/os-volume_attachments => generated 194 bytes in 12275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:55:57.375341 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:57.376150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:57.396529 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:57.397162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:57.398052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:57.398998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:57.600734 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:57.610893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aa1b687f-8b85-465c-8758-524ce4e8a3a3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.239540 Jul 19 20:55:57.611571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 103/199] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:57 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:58.629385 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:58.630297 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:58.637429 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.638149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.639038 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:58.639481 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:58.909439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:55:58.917813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-02cd1c6c-fe9f-4344-bb16-73890f4937cf tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.293177 Jul 19 20:55:58.918593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 97/200] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:58 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:55:59.936189 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:55:59.936962 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:55:59.943564 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=64 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:59.945328 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:59.945965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:55:59.947033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:55:59.947689 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:00.149052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:00.159032 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-95eb3c2e-9a30-4fa1-a2e6-7edcffc0902f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.227354 Jul 19 20:56:00.159983 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 104/201] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:55:59 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:01.178730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:01.180280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:01.190756 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:01.191505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:01.192801 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:01.193774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:01.385609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:01.395315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1a3ab0ce-ef0f-4043-a72a-7f8e1d926a67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.222457 Jul 19 20:56:01.397360 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 98/202] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:01 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:02.413932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:02.414541 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:02.421333 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:02.421986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:02.422754 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:02.423183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:02.589254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:02.597772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc93993e-470d-4656-8a0b-04e33c0a61f9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.188694 Jul 19 20:56:02.598445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 105/203] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:02 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:03.622147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:03.623164 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:03.633399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:03.634173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:03.635526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:03.636304 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:03.786874 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:03.794308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0023ea34-eb80-46aa-94cb-95ebd83edec9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.181528 Jul 19 20:56:03.794853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 99/204] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:03 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:04.812091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:04.812809 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:04.819327 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:04.819770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:04.820579 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:04.821012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:04.966803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:04.975233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fdbb7d06-efe0-49fe-b277-030bd5699f96 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.168016 Jul 19 20:56:04.975811 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 106/205] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:04 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:05.422915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-e75bff18-ffc7-4c1f-ab54-01b572bfcfe6 req-3b1def93-340d-4c43-b302-98fd8bd82eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b78a6c-835d-428c-a95e-af5086bc78cc", "name": "network-vif-plugged", "status": "completed", "tag": "d37425cd-697a-4728-84c4-f585013a5e98"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:05.431424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e75bff18-ffc7-4c1f-ab54-01b572bfcfe6 req-3b1def93-340d-4c43-b302-98fd8bd82eec service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:05.431801 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e75bff18-ffc7-4c1f-ab54-01b572bfcfe6 req-3b1def93-340d-4c43-b302-98fd8bd82eec service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:05.445959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-e75bff18-ffc7-4c1f-ab54-01b572bfcfe6 req-3b1def93-340d-4c43-b302-98fd8bd82eec service nova] Creating event network-vif-plugged:d37425cd-697a-4728-84c4-f585013a5e98 for instance 07b78a6c-835d-428c-a95e-af5086bc78cc on hv-cinder-74915 Jul 19 20:56:05.452906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-e75bff18-ffc7-4c1f-ab54-01b572bfcfe6 req-3b1def93-340d-4c43-b302-98fd8bd82eec service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 Jul 19 20:56:05.453616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 100/206] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:05.993740 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:05.994401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:06.001375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:06.001823 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:06.002584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:06.003015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:06.134478 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:06.141999 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1a138d98-53cd-4aa1-9aaf-25152f3610ee tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.152333 Jul 19 20:56:06.142561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 107/207] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:05 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:07.160823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:07.162227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:07.174718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:07.175283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:07.175886 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:07.176452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:07.321047 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:07.329159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-df75cb97-c31b-4d90-97f0-76e6d13b54bc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.173702 Jul 19 20:56:07.329739 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 101/208] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:07 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:08.347087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:08.347691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:08.354146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:08.354595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:08.355372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:08.355810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:08.484838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:08.493054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e00c9d30-0225-4d6e-8ff2-ec6d166d8eca tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.150500 Jul 19 20:56:08.493613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 108/209] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:08 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:09.509224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:09.509792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:09.516672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:09.517115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:09.517880 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:09.518313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:09.651856 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:09.659703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f7b7ce01-7d02-42a4-a34c-4dfbcf10aff4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.154416 Jul 19 20:56:09.660262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 102/210] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:09 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:10.676794 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:10.677504 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:10.683617 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:10.684068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:10.684942 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:10.685380 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:10.816263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:10.824167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9145c0d5-4b04-4e83-92b9-8f03d380507c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.151130 Jul 19 20:56:10.824766 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 109/211] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:10 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:11.841605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:11.842142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:11.849125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:11.849693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:11.850467 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:11.850972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:11.989418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:11.997773 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2674f649-f970-4378-8888-fe3f2da0cff5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.160033 Jul 19 20:56:11.998460 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 103/212] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:11 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:13.015945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:13.016579 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:13.022693 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:13.023128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:13.023888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:13.024312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:13.156792 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:13.164532 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cba2200a-4f1c-4725-a7cc-c0751dd78b79 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1319 microversion: 2.1 time: 0.153599 Jul 19 20:56:13.165104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 110/213] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:13 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:14.181025 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:14.181629 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:14.188245 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:14.189008 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:14.189821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:14.190308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:14.330507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:14.338904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1ab8b086-31fe-4a25-84e9-18ca2be9d03f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1509 microversion: 2.1 time: 0.161582 Jul 19 20:56:14.339503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 104/214] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:14 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:24.011234 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:24.011888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:24.015349 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=13 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.016490 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=74 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.020551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:24.020995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:24.021766 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:24.022202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:24.054364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:56:24.184202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f25f7f37-cf7c-4b8d-b4a3-3eb084edd000 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 204 len: 0 microversion: 2.1 time: 0.176528 Jul 19 20:56:24.185300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 111/215] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:56:24 2022] DELETE /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:56:24.191013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=16 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:24.198116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:24.198807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:24.209170 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:24.209619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:24.214340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:24.214788 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:24.390313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:24.405443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8582206e-e94e-4bf5-9091-161aac8cb5b1 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.215274 Jul 19 20:56:24.407177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 105/216] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:24 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:25.425766 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:25.426393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:25.434041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:25.434775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:25.435583 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:25.436063 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:25.638052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:25.647042 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2c7d40c5-66ad-4878-a1b2-d8859a909447 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.226943 Jul 19 20:56:25.647550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 112/217] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:25 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:26.664761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:26.665445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:26.672150 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:26.672626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:26.673398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:26.673883 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:26.676576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:26.818708 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:26.827960 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4501fbb5-fd83-468c-a29d-30d459ce536a tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.166868 Jul 19 20:56:26.828557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 106/218] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:26 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:27.845057 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:27.845701 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:27.852012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.852497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:27.853257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:27.853859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:28.003720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:28.011729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5c8fa29d-9d86-41ed-8570-80e60c3c20b6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.170679 Jul 19 20:56:28.012293 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 113/219] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:27 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:29.034402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:29.035085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:29.041826 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:29.042276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.043048 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:29.043482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:29.178239 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:29.186325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-310ce242-e7b5-4be7-bdf5-59f4ac37800e tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.155631 Jul 19 20:56:29.187057 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 107/220] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:29 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:30.204339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:30.204950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:30.211550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.211992 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.212791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:30.213220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:30.344788 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:30.353188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a189a7e0-683a-4214-9a66-dbede1cb2794 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.153257 Jul 19 20:56:30.353759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 114/221] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:30 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:31.371100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:31.371705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:31.382644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.383142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.383982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:31.384553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:31.540929 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:31.549766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-51b9a2b0-9c00-4fbf-9c00-9af9f1ffe509 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.182434 Jul 19 20:56:31.550351 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 108/222] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:31 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:32.567010 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:32.567615 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:32.573666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.574109 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.574868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:32.575299 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:32.729665 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:32.740696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1480e6d0-2de6-4f97-931b-df4b26bcacde tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.177592 Jul 19 20:56:32.741283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 115/223] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:32 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:33.761027 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:33.761027 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:33.770635 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:33.771100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:33.771892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:33.772381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.005095 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:34.014002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-26ce8e90-c36c-40f0-98e8-d1a88282a956 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1551 microversion: 2.1 time: 0.258401 Jul 19 20:56:34.014537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 109/224] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:33 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1551 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:34.347508 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-1f708d94-f0a7-4422-88a5-237911999d7f req-79145721-c9d3-4af4-8f5a-b346782902b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf6bbdb-013e-482c-8bca-2dbc9d36cd96", "name": "network-vif-deleted", "tag": "86466281-274b-49aa-b377-d3bad13d7f7a"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:34.357298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-1f708d94-f0a7-4422-88a5-237911999d7f req-79145721-c9d3-4af4-8f5a-b346782902b7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:34.358123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-1f708d94-f0a7-4422-88a5-237911999d7f req-79145721-c9d3-4af4-8f5a-b346782902b7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:34.375399 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-1f708d94-f0a7-4422-88a5-237911999d7f req-79145721-c9d3-4af4-8f5a-b346782902b7 service nova] Creating event network-vif-deleted:86466281-274b-49aa-b377-d3bad13d7f7a for instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 on hv-cinder-74915 Jul 19 20:56:34.386101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-1f708d94-f0a7-4422-88a5-237911999d7f req-79145721-c9d3-4af4-8f5a-b346782902b7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042265 Jul 19 20:56:34.387024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 116/225] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:35.032884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:35.033713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:35.041286 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.041744 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.042585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:35.043544 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:35.111037 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:35.118987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-efb77a25-1140-4364-b8ba-de37110b51ee tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1344 microversion: 2.1 time: 0.091230 Jul 19 20:56:35.119555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 110/226] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:35 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:36.137047 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:36.137734 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:36.148000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.148000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.148000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.148000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.182566 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:36.183075 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:36.183537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lazy-loading 'fault' on Instance uuid 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:56:36.240853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284d7172360641a6b039d1bc23e1152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79723635097c40588d8dfedceb79ee68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:36.249801 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fce74088-3d01-47d0-a285-6bb5a433e150 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 200 len: 1349 microversion: 2.1 time: 0.116902 Jul 19 20:56:36.250743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 117/227] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:36 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 1349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:37.268168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:37.268810 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:37.275803 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.276249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.277049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.277473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.291910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] HTTP exception thrown: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Request method failure captured: Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 HTTP/1.1 Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoPWJXcr1khKYAHtKo3vH0oO33lPlIQ6iq583OqI6l66lvrLo_aprLdUjdry0IQ53MBni-ALz_IFkEkoHAAWe-mp2Oy151xLu3drkObFV8oLGPx87YXgD11ahH_hKiHsPFwZ6xk08MZXqeQ4269Et3rTrf9t6jcay5KwRxUhaH975c Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 20:56:37.297010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/79723635097c40588d8dfedceb79ee68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_79723635097c40588d8dfedceb79ee68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 284d7172360641a6b039d1bc23e1152e Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.298636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '6cf6bbdb-013e-482c-8bca-2dbc9d36cd96'} Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:37.299621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.301224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.302775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Returning 404 to user: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:37.302775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5cf14f0d-bac8-4751-a5f6-c8f3c00dbcf6 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 404 len: 111 microversion: 2.1 time: 0.035040 Jul 19 20:56:37.302775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 111/228] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:37 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:56:37.415386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:37.416310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:37.422492 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.422925 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.423713 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:37.424137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:37.439564 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] HTTP exception thrown: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Request method failure captured: Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96/os-volume_attachments HTTP/1.1 Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoPWJXcr1khKYAHtKo3vH0oO33lPlIQ6iq583OqI6l66lvrLo_aprLdUjdry0IQ53MBni-ALz_IFkEkoHAAWe-mp2Oy151xLu3drkObFV8oLGPx87YXgD11ahH_hKiHsPFwZ6xk08MZXqeQ4269Et3rTrf9t6jcay5KwRxUhaH975c Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:56:37.444178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/79723635097c40588d8dfedceb79ee68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_79723635097c40588d8dfedceb79ee68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 284d7172360641a6b039d1bc23e1152e Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.445659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'server_id': '6cf6bbdb-013e-482c-8bca-2dbc9d36cd96'} Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:37.446446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:37.447683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:37.448977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Returning 404 to user: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:37.448977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-180fa2c3-fdce-4185-9059-641a94336396 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034560 Jul 19 20:56:37.449598 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 118/229] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 20:56:37 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:56:38.705224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:38.706463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:38.716689 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.718165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.718477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.719251 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.769609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] HTTP exception thrown: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Request method failure captured: Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 HTTP/1.1 Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoPWJXcr1khKYAHtKo3vH0oO33lPlIQ6iq583OqI6l66lvrLo_aprLdUjdry0IQ53MBni-ALz_IFkEkoHAAWe-mp2Oy151xLu3drkObFV8oLGPx87YXgD11ahH_hKiHsPFwZ6xk08MZXqeQ4269Et3rTrf9t6jcay5KwRxUhaH975c Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 20:56:38.773204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/79723635097c40588d8dfedceb79ee68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_79723635097c40588d8dfedceb79ee68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 284d7172360641a6b039d1bc23e1152e Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.774438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '6cf6bbdb-013e-482c-8bca-2dbc9d36cd96'} Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:38.775101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.776179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.777755 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Returning 404 to user: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:38.777755 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-869ef773-f610-4774-90d4-958b578beee3 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 404 len: 111 microversion: 2.1 time: 0.076576 Jul 19 20:56:38.781161 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 112/230] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:56:38 2022] DELETE /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:56:38.788681 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:38.790026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] [instance: 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:38.798813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.799523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.800922 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:38.801776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:38.820881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] HTTP exception thrown: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Request method failure captured: Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 HTTP/1.1 Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoPWJXcr1khKYAHtKo3vH0oO33lPlIQ6iq583OqI6l66lvrLo_aprLdUjdry0IQ53MBni-ALz_IFkEkoHAAWe-mp2Oy151xLu3drkObFV8oLGPx87YXgD11ahH_hKiHsPFwZ6xk08MZXqeQ4269Et3rTrf9t6jcay5KwRxUhaH975c Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:56:38.823883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/79723635097c40588d8dfedceb79ee68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/79723635097c40588d8dfedceb79ee68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_79723635097c40588d8dfedceb79ee68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 79723635097c40588d8dfedceb79ee68 Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1248444278 Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 284d7172360641a6b039d1bc23e1152e Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-DeleteServersTestJSON-1248444278-project Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.825407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '6cf6bbdb-013e-482c-8bca-2dbc9d36cd96'} Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:56:38.826134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. Jul 19 20:56:38.827997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:56:38.830074 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] Returning 404 to user: Instance 6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:56:38.831095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f2296448-6da5-4935-9ea0-fbf81ffdcb84 tempest-DeleteServersTestJSON-1248444278 tempest-DeleteServersTestJSON-1248444278-project] 10.222.0.85 "GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96" status: 404 len: 111 microversion: 2.1 time: 0.047726 Jul 19 20:56:38.832238 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 119/231] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:38 2022] GET /compute/v2.1/servers/6cf6bbdb-013e-482c-8bca-2dbc9d36cd96 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:56:51.587229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=16 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:51.587229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=33 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:51.749774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-211937425", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:51.871925 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] validate_networks() for [('8e45be69-2346-4883-ae4c-d926b2ce64cf', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:56:52.384490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:56:52.384908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:56:52.385714 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:56:52.386196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:56:52.386525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:56:52.396965 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:52.397226 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:52.398325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:52.398763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:52.421374 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for project d5af714b14ba471980868293588841fd. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:52.425550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for user ac1b24e50c894dcf8e887275fd91a174 and project d5af714b14ba471980868293588841fd. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:52.437712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:56:52.440271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:56:52.498591 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b5df6b9b-7ecb-4297-87d3-c570193fda2e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.918090 Jul 19 20:56:52.499767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 113/232] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:56:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:56:52.510175 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1b52b377-b42c-4dbe-b212-18e95fbd3a7c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:52.511045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1b52b377-b42c-4dbe-b212-18e95fbd3a7c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:52.514112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:52.514880 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:52.611578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1b52b377-b42c-4dbe-b212-18e95fbd3a7c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:52.630584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1b52b377-b42c-4dbe-b212-18e95fbd3a7c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1221 microversion: 2.1 time: 0.124584 Jul 19 20:56:52.632581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 120/233] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:52 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:52.704244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1190101743", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:52.807352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] validate_networks() for [('8e45be69-2346-4883-ae4c-d926b2ce64cf', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:56:53.418638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:56:53.419057 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:56:53.419534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:56:53.419963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:56:53.420383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:56:53.432147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.433181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.434818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:53.436434 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:53.463012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for project d5af714b14ba471980868293588841fd. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:56:53.470241 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for user ac1b24e50c894dcf8e887275fd91a174 and project d5af714b14ba471980868293588841fd. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:56:53.499850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:56:53.502227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:56:53.568607 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b140927a-f194-4708-8b12-6e25b6f8ab3f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.870424 Jul 19 20:56:53.569262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 114/234] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:56:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:56:53.583839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0ae15510-198b-40e9-925b-7d34c39f197b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:53.584496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0ae15510-198b-40e9-925b-7d34c39f197b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:53.682106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0ae15510-198b-40e9-925b-7d34c39f197b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:53.709676 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0ae15510-198b-40e9-925b-7d34c39f197b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1222 microversion: 2.1 time: 0.133254 Jul 19 20:56:53.720949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 121/235] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:53 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:54.744210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:54.749412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:54.798418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:54.817780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:54.818844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:54.822192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:55.049215 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:55.078041 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c2a6d734-412e-4882-80c1-b989c9b31adf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1226 microversion: 2.1 time: 0.343048 Jul 19 20:56:55.092621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 115/236] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:54 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1226 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:56:56.108353 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:56.110028 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:56.157165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:56.158591 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:56.159436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:56.160265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:56.483525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:56.493440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-28c97c0e-5215-4897-80f9-4b6bd4b3d19f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1280 microversion: 2.1 time: 0.391404 Jul 19 20:56:56.509055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 122/237] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:56 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1280 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:57.512999 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:57.514560 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:57.523881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:57.524460 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:57.525537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:57.525975 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:57.730477 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-5c890b62-f94b-4d38-b6ae-8765f90aa5db req-4b8fec8f-2a37-4870-a67e-f0fd13631720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4180f91-4020-48ce-ad4c-be5c214df7e2", "tag": "06728cc2-3664-4d69-baa1-c93eec930eb2"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:57.789154 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5c890b62-f94b-4d38-b6ae-8765f90aa5db req-4b8fec8f-2a37-4870-a67e-f0fd13631720 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:57.797171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5c890b62-f94b-4d38-b6ae-8765f90aa5db req-4b8fec8f-2a37-4870-a67e-f0fd13631720 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:57.858461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-5c890b62-f94b-4d38-b6ae-8765f90aa5db req-4b8fec8f-2a37-4870-a67e-f0fd13631720 service nova] Creating event network-changed:06728cc2-3664-4d69-baa1-c93eec930eb2 for instance e4180f91-4020-48ce-ad4c-be5c214df7e2 on hv-cinder-74915 Jul 19 20:56:57.880271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-5c890b62-f94b-4d38-b6ae-8765f90aa5db req-4b8fec8f-2a37-4870-a67e-f0fd13631720 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154760 Jul 19 20:56:57.880981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 123/238] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:56:58.556669 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:58.579120 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-33efb5ba-1142-414a-947f-2aca8fd12e97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1280 microversion: 2.1 time: 1.069852 Jul 19 20:56:58.580063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 116/239] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:57 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1280 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:56:59.465618 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-3274f588-8a8d-4c50-a9ed-0638583f7c5e req-5dedcd4c-6537-43cb-9add-3e0910444194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8ed827-778b-49c4-bcf7-f961fc9f6666", "tag": "e7821998-b80f-494c-a63a-f62d3b8dff51"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:56:59.485857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3274f588-8a8d-4c50-a9ed-0638583f7c5e req-5dedcd4c-6537-43cb-9add-3e0910444194 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:59.486317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3274f588-8a8d-4c50-a9ed-0638583f7c5e req-5dedcd4c-6537-43cb-9add-3e0910444194 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:59.502036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-3274f588-8a8d-4c50-a9ed-0638583f7c5e req-5dedcd4c-6537-43cb-9add-3e0910444194 service nova] Creating event network-changed:e7821998-b80f-494c-a63a-f62d3b8dff51 for instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 on hv-cinder-74915 Jul 19 20:56:59.507522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-3274f588-8a8d-4c50-a9ed-0638583f7c5e req-5dedcd4c-6537-43cb-9add-3e0910444194 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045816 Jul 19 20:56:59.508525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 124/240] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:56:59.596298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:56:59.596839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:56:59.603961 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:59.604428 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:59.605242 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:56:59.605693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:56:59.753839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:56:59.764792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ff3b8650-57b6-4240-9d3e-e19c5bbdae78 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.172002 Jul 19 20:56:59.765792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 117/241] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:56:59 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:00.783691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:00.784656 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:00.791376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:00.791865 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:00.792679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:00.793113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:00.952061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:00.960081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fbf3b97b-10ef-4eef-b5bb-6992dd1a481a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.181427 Jul 19 20:57:00.964256 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 125/242] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:00 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:01.977267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:01.977866 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:01.985044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:01.985489 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:01.986253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:01.986683 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:02.155942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:02.164617 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1723c992-f178-4122-85b3-c280f17ab6d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.190924 Jul 19 20:57:02.165302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 118/243] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:01 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:03.186900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:03.187446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:03.194767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.195263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.196034 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:03.196492 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:03.363094 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:03.371986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-404adc4e-d5bc-401d-bcd2-fd144a8b7376 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.189773 Jul 19 20:57:03.372653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 126/244] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:03 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:04.390863 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:04.391464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:04.393891 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=4 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:04.394546 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=12 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:04.401034 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:04.401473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:04.402232 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:04.402682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:04.534529 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:04.541862 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c17732d6-db6b-425f-bb21-805c0fd38168 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.156635 Jul 19 20:57:04.542522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 119/245] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:04 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:05.558959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:05.559487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:05.561489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:05.567456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.568166 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.568788 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:05.569226 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:05.707374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:05.715427 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5d7506b4-9423-440a-b00d-73081dd573be tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.160543 Jul 19 20:57:05.716012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 127/246] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:05 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:06.737916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:06.738500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:06.744831 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.745283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.746049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:06.746486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:06.883187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:06.891500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a923a9da-08fc-4443-9dc3-6154ad70c99f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.158162 Jul 19 20:57:06.892066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 120/247] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:06 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:07.907452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:07.908131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:07.914752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.915249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:07.916035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:07.916496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:08.054513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:08.063439 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d49e3baa-cc96-4661-aa7a-32b896d17923 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.159734 Jul 19 20:57:08.064010 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 128/248] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:07 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:08.460267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b0784cb-7c85-4c84-99fd-a0a35d9cdec1", "device": "/dev/sdb"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:08.462509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:08.471952 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:08.472909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:08.483536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:08.483536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:08.800298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ceb9943c-8fb8-4693-8b05-06dde8cafade tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "POST /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344690 Jul 19 20:57:08.800953 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 121/249] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 20:57:08 2022] POST /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:09.080708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:09.081554 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:09.088065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:09.088560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:09.089342 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:09.089780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:09.251368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:09.263674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d544c049-3899-4d45-97be-0806e524e44e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.186806 Jul 19 20:57:09.264593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 129/250] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:09 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:10.282085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:10.282691 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:10.289345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.289788 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.290555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:10.291088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:10.429313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:10.438276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-12985c50-65ea-4430-9059-a9ad3056e70a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.161501 Jul 19 20:57:10.438843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 122/251] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:10 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:11.456107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:11.456900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:11.464368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.464805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.465581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:11.466010 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:11.608946 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:11.616598 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-58fede3f-4e37-44d3-a439-b931a233268a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.165302 Jul 19 20:57:11.619195 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 130/252] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:11 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:12.633963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:12.634576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:12.641572 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.642018 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.642816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:12.643251 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:12.779224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:12.786608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e6a23a98-0271-4d58-992f-67999eb8153e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.156596 Jul 19 20:57:12.787167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 123/253] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:12 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:13.804120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:13.804783 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:13.811909 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.812415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.813414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:13.813589 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:13.949512 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:13.957668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f5eae277-5a94-4b9a-83c7-a31d54a59695 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.158321 Jul 19 20:57:13.958236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 131/254] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:13 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:14.975912 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:14.976908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:14.984416 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.985110 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:14.985780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:14.986345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:15.146062 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:15.157342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ba6bf263-e8e0-4121-bb70-b6737d5baf6d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.185737 Jul 19 20:57:15.157927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 124/255] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:14 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:16.181147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:16.181961 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:16.188158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.188598 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.189833 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:16.190264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:16.419310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:16.427654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ea62d55d-bef4-40a5-a85b-e97604532998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.255919 Jul 19 20:57:16.437287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 132/256] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:16 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:17.445416 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:17.446102 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:17.452805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:17.453342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:17.454207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:17.454696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:17.615903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:17.623822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ef81ad76-a563-43d8-b4db-7930b544e207 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.182499 Jul 19 20:57:17.628913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 125/257] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:17 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:18.640886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:18.641768 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:18.650123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:18.650571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:18.651416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:18.651843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:18.819324 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:18.827994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f7d4f5ce-395d-4ba8-9ce6-cf7b16116f7e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.190880 Jul 19 20:57:18.829140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 133/258] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:18 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:19.845722 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:19.846311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:19.853000 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.853437 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.854196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:19.854625 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:19.986928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:19.994378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-754185e4-11e5-451d-9cbb-e33c77055fde tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.152799 Jul 19 20:57:19.994947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 126/259] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:19 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:21.011583 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:21.012169 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:21.019225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.019674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.020460 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.020887 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.157384 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:21.164810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7d6d47e5-6c4d-434d-8e07-852d2a86727c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.157000 Jul 19 20:57:21.165377 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 134/260] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:21 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:21.936682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-b6aa648a-362a-4520-acce-3483325cfdde req-618ca0fc-4a39-4152-8078-6a3f44a6daef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4180f91-4020-48ce-ad4c-be5c214df7e2", "name": "network-vif-plugged", "status": "completed", "tag": "06728cc2-3664-4d69-baa1-c93eec930eb2"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:21.941152 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:21.948305 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-b6aa648a-362a-4520-acce-3483325cfdde req-618ca0fc-4a39-4152-8078-6a3f44a6daef service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:21.949086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-b6aa648a-362a-4520-acce-3483325cfdde req-618ca0fc-4a39-4152-8078-6a3f44a6daef service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:21.953582 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:21.962847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-b6aa648a-362a-4520-acce-3483325cfdde req-618ca0fc-4a39-4152-8078-6a3f44a6daef service nova] Creating event network-vif-plugged:06728cc2-3664-4d69-baa1-c93eec930eb2 for instance e4180f91-4020-48ce-ad4c-be5c214df7e2 on hv-cinder-74915 Jul 19 20:57:21.969332 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-b6aa648a-362a-4520-acce-3483325cfdde req-618ca0fc-4a39-4152-8078-6a3f44a6daef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037244 Jul 19 20:57:21.970101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 127/261] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:22.181461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:22.182068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:22.188214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:22.188802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.189470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:22.190160 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:22.327065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:22.334568 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-41d0604c-9374-48bc-b492-26dd298cd4ee tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.156943 Jul 19 20:57:22.335121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 135/262] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:22 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:23.355240 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:23.356894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:23.368409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.369265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.370285 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:23.370931 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:23.500999 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-908413780", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "networks": [{"uuid": "86f68190-d00e-45c7-b9d6-5528601db6fe"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:23.537300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=37 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:23.594824 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] validate_networks() for [('86f68190-d00e-45c7-b9d6-5528601db6fe', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:57:23.767436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:23.787139 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e5d068d-1d0f-41bf-8732-7dc52c2a6469 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.437862 Jul 19 20:57:23.788367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 128/263] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:23 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:24.145923 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:57:24.146410 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:57:24.146804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:57:24.147209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:57:24.147613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:57:24.157645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.158099 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.158996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.159346 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.168448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=77 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:24.180606 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Getting quotas for project 051e2bfc96334054956366e1308d067d. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:57:24.186896 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Getting quotas for user 72aaaf0bf8ee461c83350055d207951e and project 051e2bfc96334054956366e1308d067d. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:57:24.198550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:57:24.201435 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:57:24.257507 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-202a4b7d-0147-489b-849d-54a80ed3c68c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762532 Jul 19 20:57:24.258171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 136/264] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:57:24.268378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4b3cef52-de5a-4f9a-b2ed-2a17d094fcaf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:24.269233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4b3cef52-de5a-4f9a-b2ed-2a17d094fcaf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:24.341399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b3cef52-de5a-4f9a-b2ed-2a17d094fcaf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:24.348200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4b3cef52-de5a-4f9a-b2ed-2a17d094fcaf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1213 microversion: 2.1 time: 0.083575 Jul 19 20:57:24.348828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 129/265] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:24 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:24.805434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:24.806095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:24.812984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.813481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.814279 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:24.814979 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:24.982902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:24.990802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-66bcba5b-6f31-423c-a012-a2e8f8f40928 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.189178 Jul 19 20:57:24.991271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 137/266] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:24 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:25.367365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:25.368890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:25.382642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:25.383036 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:25.383839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:25.384588 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:25.461588 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:25.470997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-96eb2a5a-ecd9-425d-be0b-75536c6e8d3c tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1209 microversion: 2.1 time: 0.108665 Jul 19 20:57:25.472321 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 130/267] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:25 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:26.008560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:26.009103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:26.016132 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.016617 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.017407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.017843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.148517 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-f1f9363f-3a65-45b3-862d-5e3926e88edc req-0486ced3-3dc4-48f7-aefa-4cfc5e23d920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8ed827-778b-49c4-bcf7-f961fc9f6666", "name": "network-vif-plugged", "status": "completed", "tag": "e7821998-b80f-494c-a63a-f62d3b8dff51"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:26.158310 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-f1f9363f-3a65-45b3-862d-5e3926e88edc req-0486ced3-3dc4-48f7-aefa-4cfc5e23d920 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.158860 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-f1f9363f-3a65-45b3-862d-5e3926e88edc req-0486ced3-3dc4-48f7-aefa-4cfc5e23d920 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.174300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-f1f9363f-3a65-45b3-862d-5e3926e88edc req-0486ced3-3dc4-48f7-aefa-4cfc5e23d920 service nova] Creating event network-vif-plugged:e7821998-b80f-494c-a63a-f62d3b8dff51 for instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 on hv-cinder-74915 Jul 19 20:57:26.181536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-f1f9363f-3a65-45b3-862d-5e3926e88edc req-0486ced3-3dc4-48f7-aefa-4cfc5e23d920 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036425 Jul 19 20:57:26.182820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 131/268] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:26.200391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.210924 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-34bcb4bf-78da-43cc-a789-42d0498679d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.205910 Jul 19 20:57:26.211799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 138/269] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:26 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:26.495508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:26.496100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:26.508919 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.509447 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.510260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:26.510698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:26.582501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:26.591946 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-779704a9-2ab7-49be-85f8-0d7d802e1c15 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1265 microversion: 2.1 time: 0.100881 Jul 19 20:57:26.592549 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 132/270] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:26 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:27.227304 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:27.227906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:27.234768 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.235207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.235974 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.236445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.372533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.382425 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3d541208-6eca-4194-8ab9-378bdf024c46 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.159083 Jul 19 20:57:27.383056 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 139/271] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:27 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:27.608642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:27.609243 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:27.617256 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.617695 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.618462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:27.618893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:27.688307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:27.695977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6bd8e768-6b9a-4a52-bbbb-2a8703e820b3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1273 microversion: 2.1 time: 0.091366 Jul 19 20:57:27.696590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 133/272] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:27 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:28.400129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:28.400771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:28.406848 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.407306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.408049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.408514 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.552585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.561288 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-618dd7a7-9e05-49d4-bc2a-70acff716edd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1322 microversion: 2.1 time: 0.165222 Jul 19 20:57:28.561870 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 140/273] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:28 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:28.713889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:28.714644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:28.724400 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.725042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.726465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:28.727069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:28.810547 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:28.818841 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ca40d12c-28be-4b67-b86f-d28c9198c8ef tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1271 microversion: 2.1 time: 0.108698 Jul 19 20:57:28.820458 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 134/274] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:28 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:29.579121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:29.579745 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.586007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.586461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.587236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.587675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.734104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:29.744156 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-47c6de04-c01d-4f2f-a5b2-4d1ebfce3ffc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1517 microversion: 2.1 time: 0.169519 Jul 19 20:57:29.744774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 141/275] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:29 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:29.761643 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:29.762750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.769520 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.769882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.770656 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.771092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.796468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lazy-loading 'flavor' on Instance uuid ec8ed827-778b-49c4-bcf7-f961fc9f6666 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:57:29.836781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:29.837383 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.843705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.844146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.845025 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.845455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.927582 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2f0d149f-7661-44f9-ab7e-e57958ac5d7b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666/action" status: 200 len: 32 microversion: 2.1 time: 0.169713 Jul 19 20:57:29.928345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 135/276] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 20:57:29 2022] POST /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 20:57:29.939115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:29.939463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:29.948604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.949156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:29.950383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:29.950982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:30.004059 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.013284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-256b512e-4e40-4883-be2b-88a80c72c2ad tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.179510 Jul 19 20:57:30.014309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 142/277] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:29 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:30.092260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:30.099715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3281e0a1-529a-4727-b35d-182bd932220d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.165793 Jul 19 20:57:30.100283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 136/278] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:29 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:31.015621 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-00fac9f3-1fac-4c0e-a3dd-5d7aa3188082 req-9bd7ba37-437f-4a40-bac9-324fc8f0611a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a401b3-ea6d-43fb-9ddb-5f1b585d35f7", "tag": "22c86683-a300-4393-9e4f-52c8d23c29f1"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:31.033010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:31.033798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:31.039393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-00fac9f3-1fac-4c0e-a3dd-5d7aa3188082 req-9bd7ba37-437f-4a40-bac9-324fc8f0611a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.043016 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-00fac9f3-1fac-4c0e-a3dd-5d7aa3188082 req-9bd7ba37-437f-4a40-bac9-324fc8f0611a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.048376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.049806 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.052920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.054646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.060534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-00fac9f3-1fac-4c0e-a3dd-5d7aa3188082 req-9bd7ba37-437f-4a40-bac9-324fc8f0611a service nova] Creating event network-changed:22c86683-a300-4393-9e4f-52c8d23c29f1 for instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 on hv-cinder-74915 Jul 19 20:57:31.067153 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-00fac9f3-1fac-4c0e-a3dd-5d7aa3188082 req-9bd7ba37-437f-4a40-bac9-324fc8f0611a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057333 Jul 19 20:57:31.068679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 143/279] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:57:31.119313 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:31.120124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:31.127176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.128244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.129039 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:31.129480 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:31.335109 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.347233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1ae3a94c-127f-4487-9a50-00e4a244da39 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.320048 Jul 19 20:57:31.347834 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 137/280] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:31 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:31.426348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:31.435686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-70cf8bd0-e068-47a1-9cc9-0e855080fe8a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.322523 Jul 19 20:57:31.445490 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 144/281] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:31 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:32.371505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:32.372131 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:32.378675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.379118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.379889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.380315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.462222 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:32.462850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:32.469549 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.470856 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.471672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:32.472119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:32.525316 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:32.533648 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ecbc9c6d-7eae-4fbd-8ad3-30c921703329 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.166050 Jul 19 20:57:32.534338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 138/282] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:32 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:32.609338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:32.616822 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1a94018a-b8c8-4c02-9608-3eec82587c5e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.158677 Jul 19 20:57:32.617387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 145/283] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:32 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:33.551064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:33.551613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:33.558236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.558676 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.559442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.559872 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.638408 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:33.639534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:33.646862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.647304 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.648094 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:33.648571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:33.840165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.849361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2ef7cdde-e2be-44f8-9859-21863abe9225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.219322 Jul 19 20:57:33.849817 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 146/284] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:33 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:33.863716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:33.871340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-28c9fd9a-8ffb-41e3-ae62-79e73148494f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.324259 Jul 19 20:57:33.872441 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 139/285] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:33 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:34.866377 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.867066 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.868853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:34.869521 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=6 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:34.876526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.877086 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.877782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.878222 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.889862 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:34.891339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:34.895064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:34.900075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.900590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:34.901375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:34.901924 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:35.075632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.083488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a651be7-2184-424a-90fa-c06ecf5836f6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.220989 Jul 19 20:57:35.084061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 147/286] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:35.097084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:35.104490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2bfca831-d830-49cf-a7a3-f05db50b11dc tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.219544 Jul 19 20:57:35.105041 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 140/287] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:34 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:36.100645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:36.101256 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:36.107869 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.108310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.109102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.109535 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.121672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:36.122305 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:36.128990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.129435 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.130211 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:36.130639 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:36.326457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:36.328529 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:36.336759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7bd35fd5-3bac-404a-b618-a2e9a676a133 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.240179 Jul 19 20:57:36.337343 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 148/288] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:36 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:36.337460 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8e0ab09c-8f5c-4681-84d5-10a1f8321897 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.219661 Jul 19 20:57:36.338019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 141/289] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:36 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:37.357469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:37.358150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:37.358508 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:37.358671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:37.368050 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:37.368788 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:37.368948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:37.369600 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:37.370040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:37.370752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:37.370877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:37.371478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:37.582113 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:37.584945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:37.591604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9bc13605-77ce-4fa2-9160-ca802290e7c5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.240538 Jul 19 20:57:37.592203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 142/290] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:37 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:37.592675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c9e7aa52-25ea-4106-b859-2b925016ba63 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.241289 Jul 19 20:57:37.593162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 149/291] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:37 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:38.610838 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:38.611447 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:38.618633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.619087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.619928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.620642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.669190 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:38.669775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:38.675926 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.676502 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.677362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:38.677950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:38.811087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:38.819893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9ad38acb-acb8-4c2e-9502-2a7bcd5e63a0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.213814 Jul 19 20:57:38.829756 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 143/292] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:38 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:38.850393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:38.858714 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-469e97ee-674c-4774-b3dd-76a0f3c884a2 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.193650 Jul 19 20:57:38.859183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 150/293] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:38 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:39.837647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:39.838200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:39.844726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.845172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.846292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.846481 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.849154 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:39.878193 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:39.879386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:39.896150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.896637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:39.898208 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:39.898517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:40.038508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:40.046079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-80367810-75d6-4f6b-876f-9b5834ae090f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.212292 Jul 19 20:57:40.046655 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 144/294] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:39 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:40.066128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:40.073427 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9592f8e8-d19c-4087-860f-7df8b5eaac7d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.199021 Jul 19 20:57:40.073992 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 151/295] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:39 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:41.062915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:41.063606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:41.070857 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.071298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.072060 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.072530 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.091101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:41.091705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:41.100728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.101475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.102706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:41.103412 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:41.282185 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:41.289467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:41.289749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-70ea77fb-454d-4199-8088-4e143a94354b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.230631 Jul 19 20:57:41.290338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 145/296] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:41 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:41.297630 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-46076964-9c35-4284-be6d-c05f5cb3af7e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.210313 Jul 19 20:57:41.298302 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 152/297] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:41 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:42.307134 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:42.307743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:42.314937 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:42.315534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:42.315710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:42.315879 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:42.316522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:42.316958 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:42.321792 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:42.322230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:42.322997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:42.323444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:42.518966 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:42.526176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:42.526679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3fcabb5f-1308-44a6-b803-1c37210ebd15 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.223586 Jul 19 20:57:42.527255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 146/298] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:42 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:42.533743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e2244f9f-4ff6-4696-93fa-7b183ba2be61 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.222772 Jul 19 20:57:42.534307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 153/299] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:42 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:43.544068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:43.544651 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:43.550687 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:43.551330 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:43.552141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.552612 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.553415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.553843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.557965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.558415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.559688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:43.560121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:43.564192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:43.755605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:43.763966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3fa6104d-d30a-4e53-a44d-602e715d53cf tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.217312 Jul 19 20:57:43.764652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 154/300] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:43 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:43.771611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:43.779254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-24b8d069-1697-4ea5-9768-40f5a6765e62 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.239286 Jul 19 20:57:43.779820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 147/301] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:43 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:44.781824 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:44.782414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:44.789081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.789522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.790293 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.790723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.795682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:44.796319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:44.802835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.803282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.804289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:44.804834 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:44.981105 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:44.989216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0f53d9a0-31cf-4c41-8abf-8844cd8ab274 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.211711 Jul 19 20:57:44.989860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 155/302] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:44 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:45.003319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:45.011032 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dbd2c246-7a71-4665-b2ae-97adc501159d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.219168 Jul 19 20:57:45.011599 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 148/303] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:44 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:46.006296 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:46.006917 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:46.012961 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:46.013410 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:46.014177 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:46.014613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:46.029237 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:46.029841 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:46.036576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:46.036870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:46.037646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:46.038078 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:46.231463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:46.231623 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:46.240870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-74ae1ffe-46ee-4867-801f-aa02131d2fd7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.216000 Jul 19 20:57:46.241436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5057002d-4341-49a7-823b-d98f423b789a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.238928 Jul 19 20:57:46.241585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 149/304] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:46 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:46.242007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 156/305] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:46 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:47.260264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:47.261482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:47.264868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:47.266692 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:47.272778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:47.273233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:47.274608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:47.275158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:47.275276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:47.275937 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:47.276969 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:47.277624 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:47.478645 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:47.483214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:47.487021 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ecea53eb-5aec-499f-8601-f170808485d4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.232661 Jul 19 20:57:47.488087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 150/306] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:47 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:47.491645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-58a25033-72e1-4299-b511-55e2bebbe1ff tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.233541 Jul 19 20:57:47.492708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 157/307] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:47 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:48.505752 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.506399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.509171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:48.509782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:48.513642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.514090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.514872 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.515330 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.516198 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.516681 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.517452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:48.517883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:48.721843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:48.726118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:48.729435 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-afecc09f-afc3-4249-912b-6fb463494685 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.224026 Jul 19 20:57:48.730008 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 158/308] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:48.733487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d17499ab-acfa-481d-a9ec-fd919f473025 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.231842 Jul 19 20:57:48.734051 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 151/309] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:48 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:49.747105 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:49.747709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:49.750446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:49.751064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:49.754054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.754494 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.755277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.755709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.757939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.758384 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.759173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:49.759608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:49.963948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:49.967101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:49.972413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-40fc0752-25bb-4b9d-8b9d-ed77eb3b132d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.225704 Jul 19 20:57:49.973002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 152/310] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:49 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:49.974838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3af024e4-addf-4184-a394-50cc71f5e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.231587 Jul 19 20:57:49.975401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 159/311] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:49 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:50.989081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:50.989723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:50.990834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:50.991442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:50.996278 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.997340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.997963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.998115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.998405 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.998548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:50.999164 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:50.999590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:51.197153 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:51.200163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:51.206499 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2f4f5dc6-65d8-4ce8-b08b-d0a4b80de8f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.221237 Jul 19 20:57:51.207079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 153/312] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:50 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:51.208892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-abda5bf3-1f91-4bae-98a2-e7380427ac12 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.221870 Jul 19 20:57:51.209460 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 160/313] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:50 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:51.888687 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:57:51.889023 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 20:57:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:57:52.224665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:52.225841 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:52.226793 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:52.227455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:52.232427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=56 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:52.235129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.235639 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:52.236503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.237104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:52.238583 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.239033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:52.239987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.240626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:52.453498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:52.456869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:52.461612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-05416a43-6134-4a5c-9315-d22f1bf4cf36 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.238884 Jul 19 20:57:52.462463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 161/314] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:52 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:52.464556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-15a67750-d1b4-4a01-ad28-c1e84acc3155 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.243994 Jul 19 20:57:52.465144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 154/315] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:52 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:52.983664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e7e2b5dc-1b87-41f1-8382-f37acfbd345d req-ec1087dc-7637-45d9-85c3-26242557c168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a401b3-ea6d-43fb-9ddb-5f1b585d35f7", "name": "network-vif-plugged", "status": "completed", "tag": "22c86683-a300-4393-9e4f-52c8d23c29f1"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:57:52.991770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e7e2b5dc-1b87-41f1-8382-f37acfbd345d req-ec1087dc-7637-45d9-85c3-26242557c168 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:52.992226 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e7e2b5dc-1b87-41f1-8382-f37acfbd345d req-ec1087dc-7637-45d9-85c3-26242557c168 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:53.004120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e7e2b5dc-1b87-41f1-8382-f37acfbd345d req-ec1087dc-7637-45d9-85c3-26242557c168 service nova] Creating event network-vif-plugged:22c86683-a300-4393-9e4f-52c8d23c29f1 for instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 on hv-cinder-74915 Jul 19 20:57:53.009519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e7e2b5dc-1b87-41f1-8382-f37acfbd345d req-ec1087dc-7637-45d9-85c3-26242557c168 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029835 Jul 19 20:57:53.010117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 162/316] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:57:53.479082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:53.479660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:53.485539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:53.486260 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:53.487579 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:53.488049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:53.488869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:53.489311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:53.494731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:53.495411 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:53.496741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:53.497381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:53.696978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:53.704629 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:53.705467 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2a2b4d52-83b0-41f8-9632-29f263a62acd tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.230569 Jul 19 20:57:53.706045 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 155/317] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:53 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:53.712937 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-535d1382-0fd7-4261-92a5-818d55dbc58e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.234345 Jul 19 20:57:53.713659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 163/318] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:53 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:54.722469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:54.723076 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:54.729907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:54.730463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:54.730851 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:54.731495 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:54.731688 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:54.731973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:54.734943 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:54.745538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:54.745538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:54.745538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:54.745538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:54.947985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:54.959044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-388706e9-3973-4922-ac1a-41c3f222d743 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1313 microversion: 2.1 time: 0.240049 Jul 19 20:57:54.960382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 156/319] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:54 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:54.961520 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:54.970290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-639c2df5-f84d-4310-a399-0337415c1c17 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.243464 Jul 19 20:57:54.972538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 164/320] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:54 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:55.976986 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:55.977692 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:55.986143 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:55.986576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:55.987354 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:55.987780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:55.988750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:55.989310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:56.001860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:56.001860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:56.001860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:56.001860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:56.212512 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:56.218848 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:56.220982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-108620af-9b41-4e60-aa37-ebb52775e6d5 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1497 microversion: 2.1 time: 0.248498 Jul 19 20:57:56.221601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 157/321] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:55 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:56.226998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-76aad29a-1ef2-486b-9da3-1c3e9630aae2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.241830 Jul 19 20:57:56.227685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 165/322] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:55 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:56.932101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:56.932612 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:56.939129 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:56.939764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:56.940820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:56.941244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:56.968774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:57:57.052014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c62f5119-18ae-4935-a85d-3ed1ace7d4ca tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "DELETE /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 204 len: 0 microversion: 2.1 time: 0.123655 Jul 19 20:57:57.052763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 158/323] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:57:56 2022] DELETE /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:57:57.060979 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:57.061585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:57.067783 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.068231 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.069064 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.069503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.122398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:57.122907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:57.129438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.129990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.130821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.131502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.160722 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:57.212943 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:57.222641 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f05eccbc-6e03-435a-945f-2ae0f50dd5f0 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1503 microversion: 2.1 time: 0.165229 Jul 19 20:57:57.223407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 166/324] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:57 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:57.244227 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:57.244891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:57.251592 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.251876 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.252641 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:57.253077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:57.268364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lazy-loading 'services' on Instance uuid 07b78a6c-835d-428c-a95e-af5086bc78cc {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:57:57.389397 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c40ccea0-b165-4826-9547-401ba9816ca6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "DELETE /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc/os-volume_attachments/5b0784cb-7c85-4c84-99fd-a0a35d9cdec1" status: 202 len: 0 microversion: 2.1 time: 0.271182 Jul 19 20:57:57.389993 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 159/325] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 20:57:57 2022] DELETE /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc/os-volume_attachments/5b0784cb-7c85-4c84-99fd-a0a35d9cdec1 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 20:57:57.396143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:57.404841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b47ad01e-795c-49f8-ab00-3bd99fe9f78a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.164987 Jul 19 20:57:57.405603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 167/326] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:57 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:57:58.242063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:58.242752 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:58.249596 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:58.250027 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:58.250782 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:58.251206 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:58.391460 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:58.400609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-24738d91-dfcd-4379-aa3b-34367e317c2d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1503 microversion: 2.1 time: 0.162776 Jul 19 20:57:58.401182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 160/327] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:58 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:58.422274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:58.422943 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:58.429304 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:58.429867 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:58.430510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:58.430945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:58.504253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 20:57:58.504481 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 20:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 20:57:58.565545 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:58.573545 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-282427a4-73f6-4ae2-a03a-7a6f40a3fed3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.155021 Jul 19 20:57:58.575071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 168/328] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:58 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:59.420284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:59.420922 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:59.427663 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:59.428108 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:59.428907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:59.429339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:59.591586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:57:59.592196 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:57:59.598493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:59.598986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:59.599978 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:57:59.600430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:57:59.603796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:59.612098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-10b2e0a3-f887-463c-b326-322f31924f64 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1503 microversion: 2.1 time: 0.196278 Jul 19 20:57:59.612768 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 161/329] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:59 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:57:59.833775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:57:59.842691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4d683b5c-b1d7-486e-a440-e3ae5ff87010 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.255476 Jul 19 20:57:59.852193 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 169/330] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:57:59 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:00.420586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-4ee59388-d6d9-4dd0-ba08-d80a81115f68 req-259e6a99-5d48-420b-8805-cbf0a82972d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a401b3-ea6d-43fb-9ddb-5f1b585d35f7", "name": "network-vif-deleted", "tag": "22c86683-a300-4393-9e4f-52c8d23c29f1"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:00.430220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-4ee59388-d6d9-4dd0-ba08-d80a81115f68 req-259e6a99-5d48-420b-8805-cbf0a82972d9 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.430637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-4ee59388-d6d9-4dd0-ba08-d80a81115f68 req-259e6a99-5d48-420b-8805-cbf0a82972d9 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.445251 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-4ee59388-d6d9-4dd0-ba08-d80a81115f68 req-259e6a99-5d48-420b-8805-cbf0a82972d9 service nova] Creating event network-vif-deleted:22c86683-a300-4393-9e4f-52c8d23c29f1 for instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 on hv-cinder-74915 Jul 19 20:58:00.455270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-4ee59388-d6d9-4dd0-ba08-d80a81115f68 req-259e6a99-5d48-420b-8805-cbf0a82972d9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039040 Jul 19 20:58:00.455922 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 162/331] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:00.630143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:00.630864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:00.639056 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.639491 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.640689 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.641114 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.665841 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:00.666418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:00.673783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.674233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.675141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.675583 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.683155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.683712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.684632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lazy-loading 'fault' on Instance uuid 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:00.703564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:58:00.731796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:00.739739 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d37b07f0-b230-4efa-8a93-8ef12d81531d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1303 microversion: 2.1 time: 0.114076 Jul 19 20:58:00.740777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 170/332] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:00 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:00.790111 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4ee1e408-037e-4ebf-906d-d3eb64cdc55c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "DELETE /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 204 len: 0 microversion: 2.1 time: 0.128791 Jul 19 20:58:00.790796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 163/333] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:00 2022] DELETE /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:58:00.799442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:00.800066 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:00.806416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.806950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.807798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.808439 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.811103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:00.860437 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:00.861291 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:00.867918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.868534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.869509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:00.870050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:00.996871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:01.005622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-66a5ead2-3bd8-4adb-9a61-013dd03d6a2e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1515 microversion: 2.1 time: 0.209956 Jul 19 20:58:01.006665 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 171/334] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:00 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:01.055361 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:01.063182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-796fc1ff-0b08-457c-986d-42fe0314618b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.207713 Jul 19 20:58:01.063749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 164/335] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:00 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:01.758148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:01.759379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:01.765991 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:01.766431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:01.767215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:01.767626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:01.800779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:01.801215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:01.801653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lazy-loading 'fault' on Instance uuid 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:01.843513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:01.851615 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0376aad2-abf3-4783-be53-ca11d9be6f81 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 200 len: 1303 microversion: 2.1 time: 0.097159 Jul 19 20:58:01.852191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 172/336] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:01 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:02.023738 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:02.024521 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:02.031990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.032454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.033360 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.033959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.082170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:02.082795 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:02.089375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.089953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.091386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.091977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.354314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:02.369650 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-77a0375d-4037-47ca-9c52-4303487d4d06 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1515 microversion: 2.1 time: 0.349469 Jul 19 20:58:02.372474 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 165/337] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:02 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:02.404310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:02.420433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-318fea77-583d-4d99-9200-92bbf17fcf23 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.341869 Jul 19 20:58:02.429370 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 173/338] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:02 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:02.869800 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:02.870677 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:02.881262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.882765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.884301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:02.884968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:02.906397 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] HTTP exception thrown: Instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 could not be found. Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Request method failure captured: Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 HTTP/1.1 Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xquLy9aAeqSXZhcfltkOHRX--dl0XpZ-kBhKZqC45nt6NzXyYF7LYZktSBquWERwiARdylmbTDPcVfavmiNBUWj6AIOBCOQBqOEMzNw1dLaZw43CV0H1Fv9Pgtwwm0FmdfGCOBSoFvxWYSGEphe0SlzBziAOdYGLCcvDOXWu5jiFHQ Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 051e2bfc96334054956366e1308d067d Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-VolumesActionsTest-642907910 Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 20:58:02.912870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/051e2bfc96334054956366e1308d067d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/051e2bfc96334054956366e1308d067d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/051e2bfc96334054956366e1308d067d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_051e2bfc96334054956366e1308d067d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-VolumesActionsTest-642907910 Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 051e2bfc96334054956366e1308d067d Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-VolumesActionsTest-642907910 Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-VolumesActionsTest-642907910-project Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 72aaaf0bf8ee461c83350055d207951e Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-VolumesActionsTest-642907910-project Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 could not be found. Jul 19 20:58:02.914276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '11a401b3-ea6d-43fb-9ddb-5f1b585d35f7'} Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 could not be found. Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:02.915042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 could not be found. Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 could not be found. Jul 19 20:58:02.916765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:02.918971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Returning 404 to user: Instance 11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:02.918971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4694583f-ac04-48a5-92c8-814c9e20a23e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7" status: 404 len: 111 microversion: 2.1 time: 0.049028 Jul 19 20:58:02.918971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 166/339] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:02 2022] GET /compute/v2.1/servers/11a401b3-ea6d-43fb-9ddb-5f1b585d35f7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:58:03.171704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1687496971", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "networks": [{"uuid": "86f68190-d00e-45c7-b9d6-5528601db6fe"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:03.226354 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] validate_networks() for [('86f68190-d00e-45c7-b9d6-5528601db6fe', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:58:03.397242 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:03.398578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:03.406659 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.407189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.408203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.408858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.781287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:03.790775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f0542c00-ecfa-40b3-b57b-07bdb347d0ef tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1515 microversion: 2.1 time: 0.397321 Jul 19 20:58:03.792295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 167/340] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:03 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:03.798194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:03.799120 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:03.807057 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.807769 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:03.809409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:03.809992 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.224094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:04.233810 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-88a7ea80-7f3d-4426-9476-136cce163d3e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.440003 Jul 19 20:58:04.234665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 168/341] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:03 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:04.311698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:58:04.312275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:58:04.312990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:58:04.313387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:58:04.313815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:58:04.323139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.323578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.324419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.324847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.342516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Getting quotas for project 051e2bfc96334054956366e1308d067d. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:04.346837 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Getting quotas for user 72aaaf0bf8ee461c83350055d207951e and project 051e2bfc96334054956366e1308d067d. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:04.358567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:58:04.361158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:58:04.419396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f8123bbd-5f0d-4038-99ad-be6b5496e5e1 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251935 Jul 19 20:58:04.420888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 174/342] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:58:04.431157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-87bcec61-86de-4ee0-8c13-6b9914f0b092 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:04.432526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-87bcec61-86de-4ee0-8c13-6b9914f0b092 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:04.745555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-87bcec61-86de-4ee0-8c13-6b9914f0b092 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:04.778177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-87bcec61-86de-4ee0-8c13-6b9914f0b092 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1214 microversion: 2.1 time: 0.350551 Jul 19 20:58:04.790783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 169/343] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:04 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:04.809560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:04.811155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:04.822362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.823497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.826008 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.826931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.836455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-bd72d3ab-ff3e-4481-9303-6580819d967d req-82e8b1ae-8610-4f39-9f19-0a39fcf0ba71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b78a6c-835d-428c-a95e-af5086bc78cc", "name": "network-vif-deleted", "tag": "d37425cd-697a-4728-84c4-f585013a5e98"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:04.861115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-bd72d3ab-ff3e-4481-9303-6580819d967d req-82e8b1ae-8610-4f39-9f19-0a39fcf0ba71 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:04.863605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-bd72d3ab-ff3e-4481-9303-6580819d967d req-82e8b1ae-8610-4f39-9f19-0a39fcf0ba71 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:04.877321 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-bd72d3ab-ff3e-4481-9303-6580819d967d req-82e8b1ae-8610-4f39-9f19-0a39fcf0ba71 service nova] Creating event network-vif-deleted:d37425cd-697a-4728-84c4-f585013a5e98 for instance 07b78a6c-835d-428c-a95e-af5086bc78cc on hv-cinder-74915 Jul 19 20:58:04.885618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-bd72d3ab-ff3e-4481-9303-6580819d967d req-82e8b1ae-8610-4f39-9f19-0a39fcf0ba71 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056848 Jul 19 20:58:04.887785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 170/344] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:04.983127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:05.001484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-243be334-d9c4-4156-9397-244bb7d7a8f5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 200 len: 1473 microversion: 2.1 time: 0.197430 Jul 19 20:58:05.009002 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 175/345] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:04 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:05.257801 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:05.258551 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:05.267193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.267850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:05.268837 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.269378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:05.498600 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:05.510071 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f29844a8-b734-43fe-b639-778186157198 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.261638 Jul 19 20:58:05.520517 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 171/346] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:05 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:05.796113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:05.796903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:05.805192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.806025 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:05.807037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:05.832566 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.025062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:06.030478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:06.035169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: 07b78a6c-835d-428c-a95e-af5086bc78cc] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:06.054083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7d681f02-d50d-4dec-8291-ece8499f82de tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1266 microversion: 2.1 time: 0.261624 Jul 19 20:58:06.067863 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 176/347] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:05 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:06.068181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:06.069380 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.070339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:06.070875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.103723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] HTTP exception thrown: Instance 07b78a6c-835d-428c-a95e-af5086bc78cc could not be found. Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Request method failure captured: Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc HTTP/1.1 Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xo0fW5uNajeKcrwRjDAp4s4t0k3H_w2c302ho3Zxp4B3fUtVpVTKiid-KXFU2JMCn61_uOEAXYTmfmPLh2Bb2ZmgFWiY54WdSuwn0PM6tTetdyeKwBbm-nxLv4-g1ulACFs58W1WDbTHDS5_1qSxAK73YYI5vnIdhCudxMeHOJBt1o Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 72c814e2b46244db93e801a78763d880 Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699061878 Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 20:58:06.106575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72c814e2b46244db93e801a78763d880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72c814e2b46244db93e801a78763d880"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72c814e2b46244db93e801a78763d880"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72c814e2b46244db93e801a78763d880"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699061878 Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 72c814e2b46244db93e801a78763d880 Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699061878 Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-VolumesSnapshotTestJSON-1699061878-project Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 483b27bfe5674a528c29a15a054cc617 Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699061878-project Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 07b78a6c-835d-428c-a95e-af5086bc78cc could not be found. Jul 19 20:58:06.107935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '07b78a6c-835d-428c-a95e-af5086bc78cc'} Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b78a6c-835d-428c-a95e-af5086bc78cc could not be found. Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:06.108887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b78a6c-835d-428c-a95e-af5086bc78cc could not be found. Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b78a6c-835d-428c-a95e-af5086bc78cc could not be found. Jul 19 20:58:06.110393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:06.117921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Returning 404 to user: Instance 07b78a6c-835d-428c-a95e-af5086bc78cc could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:06.118959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d8027eb5-82db-42d4-a9ff-d4f6820978a5 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc" status: 404 len: 111 microversion: 2.1 time: 0.100636 Jul 19 20:58:06.120483 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 172/348] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:06 2022] GET /compute/v2.1/servers/07b78a6c-835d-428c-a95e-af5086bc78cc => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 20:58:06.528033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:06.529432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:06.537456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:06.538549 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.538926 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:06.539471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:06.901680 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:06.917219 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7d22ba39-04f9-4fe8-bc22-6e2e2192f349 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.393887 Jul 19 20:58:06.918728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 177/349] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:06 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:07.080288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:07.082302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:07.097167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.098309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.099937 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.101006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.237794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:07.248600 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c0df7fd4-153f-4283-b141-b2f562df0961 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1272 microversion: 2.1 time: 0.176971 Jul 19 20:58:07.259036 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 173/350] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:07 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:07.935485 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:07.936093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:07.943603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.944047 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:07.944859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:07.945296 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:08.104316 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:08.117818 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4e35a08a-da6a-44c2-90cc-a642cb35d60d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.186162 Jul 19 20:58:08.119375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 178/351] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:07 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:08.270704 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:08.271466 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:08.280132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:08.280608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:08.281541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:08.281978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:08.740144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:08.751624 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8b1dd3f6-cb8c-41ef-abb0-3c906ebbe287 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.488171 Jul 19 20:58:08.752944 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 174/352] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:08 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:09.140719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:09.141664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:09.149166 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:09.149897 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:09.151041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:09.151959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:09.531718 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:09.552527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-04915cbf-607a-4b45-b7cc-edbacf47538e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.420846 Jul 19 20:58:09.553036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 179/353] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:09 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:09.772744 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:09.774272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:09.786663 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:09.787243 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:09.788058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:09.788761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.164107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:10.172715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-30466345-61eb-4f5c-b778-7bf0e3ce5c27 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.406178 Jul 19 20:58:10.176711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 175/354] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:09 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:10.571547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:10.572278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:10.579064 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.580135 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:10.581863 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:10.582549 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.188613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:11.192150 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:11.192867 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:11.200216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8976a570-00ac-4592-bdaf-565a86f7ddb8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.633526 Jul 19 20:58:11.201520 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 180/355] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:10 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:11.210997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.211440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.212296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:11.214369 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:11.620211 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:11.631547 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2b5f6cde-608d-4eaa-b987-0974843ed9b6 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.444206 Jul 19 20:58:11.641272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 176/356] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:11 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:12.132152 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-be9d3cc9-cf70-43be-bca3-99dbff8c39bc req-68324ee7-c8b0-4090-bb45-71d0845687b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485", "tag": "2e34ab60-de6c-4678-9b36-933ba3da1288"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:12.142397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-be9d3cc9-cf70-43be-bca3-99dbff8c39bc req-68324ee7-c8b0-4090-bb45-71d0845687b6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.143122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-be9d3cc9-cf70-43be-bca3-99dbff8c39bc req-68324ee7-c8b0-4090-bb45-71d0845687b6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.167672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-be9d3cc9-cf70-43be-bca3-99dbff8c39bc req-68324ee7-c8b0-4090-bb45-71d0845687b6 service nova] Creating event network-changed:2e34ab60-de6c-4678-9b36-933ba3da1288 for instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 on hv-cinder-74915 Jul 19 20:58:12.175251 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-be9d3cc9-cf70-43be-bca3-99dbff8c39bc req-68324ee7-c8b0-4090-bb45-71d0845687b6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046807 Jul 19 20:58:12.176534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 181/357] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:12.228985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:12.230311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:12.239356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.240144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.241364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.242129 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.247195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:12.649085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:12.649791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:12.657080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.657531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.658326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:12.658761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:12.829350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:12.838456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-53010133-e54b-4ed4-88d2-530238f36bfe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.613997 Jul 19 20:58:12.839179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 177/358] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:12 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:12.990114 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:12.999630 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b52eb596-1665-42de-84f6-cd769d60c251 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.354659 Jul 19 20:58:13.009934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 182/359] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:12 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:13.855802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:13.856434 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:13.864087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.864587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:13.865369 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:13.865984 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.024217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:14.024855 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:14.025696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:14.034503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:14.035147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e0105750-b9be-44de-93e0-cd8c9bbdc32a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.183481 Jul 19 20:58:14.035346 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.036854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 178/360] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:13 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:14.037039 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:14.037624 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:14.241175 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:14.259550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0c2c1339-c0e8-45d3-bcf5-7fbba93afd85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.245199 Jul 19 20:58:14.260426 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 183/361] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:14 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:15.052357 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:15.053433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:15.055531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:15.062098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.062544 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.063317 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.063847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.169686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:15.170587 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=6 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:15.242305 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:15.251280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e062782f-f3d1-4d55-9695-b122994029a7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.202686 Jul 19 20:58:15.253207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 179/362] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:15 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:15.277127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:15.277816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:15.291186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.291821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.296623 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:15.296623 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:15.390960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9602e89a-139e-4dfa-b44c-27cd5f3207a2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Action: 'create', calling method: .version_select at 0x7f12640aaf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-897274336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxfAxv4JSLGCole34O6QGKMqxTq2MZKyyQ3iYcnv4Dv827IinefDWyxSrN/3Irb7pVbUw3jCLZ2odPCg1BxRdWIDBSlSNdfVZw8ERCBWyADC9RfGxg3AXw3KyD+gORGdA=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:15.411533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-9602e89a-139e-4dfa-b44c-27cd5f3207a2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for project e08c8f78187d474a865ea712616685cc. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:15.416310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-9602e89a-139e-4dfa-b44c-27cd5f3207a2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for user 5634da4012cc4d468f84409736c28e09 and project e08c8f78187d474a865ea712616685cc. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:15.451990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9602e89a-139e-4dfa-b44c-27cd5f3207a2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.287581 Jul 19 20:58:15.452672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 184/363] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 20:58:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:15.453514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:15.462924 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e480a3da-6153-40e4-814b-d53a12d36473 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.190022 Jul 19 20:58:15.463495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 180/364] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:15 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:16.277925 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:16.278541 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:16.284712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.285167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.285937 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.286367 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.469517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:16.478482 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ca8ace2a-9cdc-4062-8b08-c0c36aac778e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.204729 Jul 19 20:58:16.481558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:16.482171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:16.489617 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 185/365] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:16 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:16.491903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.492484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.493398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:16.493858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:16.651026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:16.661829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ed9f8d83-a850-4822-8428-b06d5eac502a tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.184549 Jul 19 20:58:16.662532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 181/366] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:16 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:17.497082 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:17.497680 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:17.503593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.504033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.504816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.505243 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.638705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:17.646732 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-da696c8d-3308-403e-9078-c954e2a32e14 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.153599 Jul 19 20:58:17.647287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 186/367] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:17 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:17.683437 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:17.684505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:17.692996 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.693445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.694272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:17.694652 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:17.836456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:17.853636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-33069467-85ca-4eb0-bea2-dabfd50fd01e tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.177207 Jul 19 20:58:17.864020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 182/368] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:17 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:18.557596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1085920371", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "networks": [{"uuid": "e63e1644-ba97-43a9-9fed-216082e4300b"}]}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:18.629685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] validate_networks() for [('e63e1644-ba97-43a9-9fed-216082e4300b', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:58:18.664836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:18.665359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:18.672481 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:18.672936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:18.673721 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:18.674261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:18.904839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:18.913940 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f7b0639d-d941-49fc-bda4-35c30570ec74 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1523 microversion: 2.1 time: 0.252777 Jul 19 20:58:18.916430 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 183/369] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:18 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:18.935601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:18.937123 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:18.954911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:18.955513 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:18.969931 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:18.970392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:19.179071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:58:19.179845 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:58:19.180576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:58:19.181340 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:58:19.181998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:58:19.196654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:19.198039 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:19.200307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:19.206325 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:19.232300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Getting quotas for project 72c814e2b46244db93e801a78763d880. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:19.235093 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:19.237256 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Getting quotas for user 483b27bfe5674a528c29a15a054cc617 and project 72c814e2b46244db93e801a78763d880. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:19.243797 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b7fdfe92-bfdd-4b93-a416-6e744e7d7f85 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.325958 Jul 19 20:58:19.244386 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 184/370] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:18 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:19.259965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:58:19.262448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:58:19.309923 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2ac4b986-760c-4b82-bc52-16f4542e8cbd tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756137 Jul 19 20:58:19.311002 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 187/371] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:58:19.334377 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ada76c4a-591e-40b6-b47e-17b88986024a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:19.335289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ada76c4a-591e-40b6-b47e-17b88986024a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:19.471545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ada76c4a-591e-40b6-b47e-17b88986024a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:19.482138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ada76c4a-591e-40b6-b47e-17b88986024a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1219 microversion: 2.1 time: 0.164174 Jul 19 20:58:19.492109 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 185/372] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:19 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:19.932280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:19.933495 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:19.939588 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:19.940478 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:19.941367 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:19.941900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.105364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:20.113299 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ff956fe6-e3d6-40a4-a947-940f680017d3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1503 microversion: 2.1 time: 0.185301 Jul 19 20:58:20.113866 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 188/373] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:19 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:20.129505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:20.131505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:20.147175 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.147621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.148516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.148954 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.264654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:20.265701 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:20.274781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.275580 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.276764 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.278066 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.318652 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:20.328716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7c0c7ad-a15b-460b-a8cd-41e5dc4f95cb tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1515 microversion: 2.1 time: 0.202780 Jul 19 20:58:20.340459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 186/374] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:20 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:20.452152 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:20.461450 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4003d191-ba85-4af9-a5f5-e3a64f52f036 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.204019 Jul 19 20:58:20.462170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 189/375] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:20 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:20.509012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:20.509875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:20.517730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.518173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.519134 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:20.519563 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:20.589972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:20.599392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1328df60-a423-473c-b555-db40a4639b1f tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1223 microversion: 2.1 time: 0.094580 Jul 19 20:58:20.599978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 187/376] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:20 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:21.482097 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:21.482797 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:21.489508 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.490014 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.490798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.491232 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.506800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:21.617038 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:21.617783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:21.625056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.625497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.626271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.626707 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.626857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:21.634652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6ab0ca5b-42e7-4c41-9fd1-efe6081593f3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.157055 Jul 19 20:58:21.635247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 190/377] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:21 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:21.688079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:21.696700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ed9a1394-0aa0-4a1d-ae43-b540a9233efa tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1223 microversion: 2.1 time: 0.083592 Jul 19 20:58:21.697270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 188/378] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:21 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:21.743428 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:21.744463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:21.750695 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.751148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.751922 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.752389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.776771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lazy-loading 'flavor' on Instance uuid e4180f91-4020-48ce-ad4c-be5c214df7e2 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:21.890164 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a0e6b5b7-dd15-418f-b34b-efe5db974ca8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/action" status: 200 len: 32 microversion: 2.1 time: 0.151342 Jul 19 20:58:21.890760 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 191/379] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:21 2022] POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 20:58:21.910297 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:21.911056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:21.917404 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.917791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:21.918575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:21.919007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.057028 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:22.065901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9818980a-0818-4722-b6e1-20120aec5659 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.168957 Jul 19 20:58:22.066444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 189/380] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:21 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:22.652777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:22.653468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:22.659825 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:22.660271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.661061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:22.661493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.715147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:22.715745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:22.718086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:22.724548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:22.725268 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.726237 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:22.726671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:22.815248 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:22.823229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-38bbd372-54aa-4e99-ac5e-4b8f54d4bb12 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1271 microversion: 2.1 time: 0.112683 Jul 19 20:58:22.824058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 190/381] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:22 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:22.861051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:22.869238 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6af09915-c278-4f18-b4a1-c901278c0be3 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.221143 Jul 19 20:58:22.869819 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 192/382] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:22 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:23.084838 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:23.085471 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:23.091617 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.092058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.092847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.093279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.321376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:23.332363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b9a824af-539d-4f6a-b48e-f3f29367280d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.251480 Jul 19 20:58:23.332960 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 191/383] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:23 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:23.842202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:23.842805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:23.845202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:23.852673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.853291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.854078 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.854520 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.887084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:23.888295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:23.925534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.925990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.926971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:23.927568 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:23.943728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:23.955790 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b5ac60f2-7c57-44c6-8417-05e7feee4865 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1277 microversion: 2.1 time: 0.117592 Jul 19 20:58:23.956951 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 193/384] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:23 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:24.098974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:24.107709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eb969d72-005c-41a9-b658-b16f87a3e014 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.224535 Jul 19 20:58:24.108284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 192/385] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:23 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:24.350234 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:24.350876 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:24.359365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.367441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.368286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.368799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.514344 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:24.522171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b5a04cc3-d5fe-4d35-bdb5-84370c18258a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.176044 Jul 19 20:58:24.523399 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 194/386] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:24 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:24.960346 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-e1f28c3c-b189-44d1-96c0-21d5a99228fd req-381d96bb-83d0-4cdb-be47-52a3c8bbb08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a022283b-dc95-47f2-b901-60749e4a4887", "tag": "e9dcd1e3-1150-485d-b697-9689f41dbeaf"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:24.969592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e1f28c3c-b189-44d1-96c0-21d5a99228fd req-381d96bb-83d0-4cdb-be47-52a3c8bbb08a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.970086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e1f28c3c-b189-44d1-96c0-21d5a99228fd req-381d96bb-83d0-4cdb-be47-52a3c8bbb08a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.977061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:24.977632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:24.982144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-e1f28c3c-b189-44d1-96c0-21d5a99228fd req-381d96bb-83d0-4cdb-be47-52a3c8bbb08a service nova] Creating event network-changed:e9dcd1e3-1150-485d-b697-9689f41dbeaf for instance a022283b-dc95-47f2-b901-60749e4a4887 on hv-cinder-74915 Jul 19 20:58:24.986966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.987426 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.988275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:24.989326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:24.993174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-e1f28c3c-b189-44d1-96c0-21d5a99228fd req-381d96bb-83d0-4cdb-be47-52a3c8bbb08a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030706 Jul 19 20:58:24.993877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 193/387] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:25.126378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:25.127171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:25.129602 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:25.133795 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.134310 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.135276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.135715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.138146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-945e3a8d-ae6d-417c-a1bb-3bb667c4e392 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.168043 Jul 19 20:58:25.138713 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 195/388] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:24 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:25.283031 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:25.291106 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bb6eb265-cd61-434f-8988-6e14676a713d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.169397 Jul 19 20:58:25.291686 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 194/389] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:25 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:25.540417 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:25.540964 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:25.548201 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.548686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.549465 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:25.549906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:25.688666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:25.696467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1ba63644-fd05-433d-8aa8-0eb7e0612e16 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.159969 Jul 19 20:58:25.697037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 196/390] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:25 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:26.155930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:26.156564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:26.164467 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.164980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.165785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.166308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.182473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:26.222192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-1283740e-62ee-4ecf-bcf5-43d8a2cdbd16 req-5a439b7e-891f-407a-8f1c-2dc635b0b985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485", "name": "network-vif-plugged", "status": "completed", "tag": "2e34ab60-de6c-4678-9b36-933ba3da1288"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:26.241912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-1283740e-62ee-4ecf-bcf5-43d8a2cdbd16 req-5a439b7e-891f-407a-8f1c-2dc635b0b985 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.242355 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-1283740e-62ee-4ecf-bcf5-43d8a2cdbd16 req-5a439b7e-891f-407a-8f1c-2dc635b0b985 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.259822 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-1283740e-62ee-4ecf-bcf5-43d8a2cdbd16 req-5a439b7e-891f-407a-8f1c-2dc635b0b985 service nova] Creating event network-vif-plugged:2e34ab60-de6c-4678-9b36-933ba3da1288 for instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 on hv-cinder-74915 Jul 19 20:58:26.267820 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-1283740e-62ee-4ecf-bcf5-43d8a2cdbd16 req-5a439b7e-891f-407a-8f1c-2dc635b0b985 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066256 Jul 19 20:58:26.269225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 197/391] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:26.310383 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:26.311089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:26.317866 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.318547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.319743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.320368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.329099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:26.336818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6caa3d4f-1036-4a0f-a1bd-0dd3e4bed7e9 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.185461 Jul 19 20:58:26.337492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 195/392] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:26 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:26.469026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:26.477085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a08e873e-1224-4fcc-a155-6398691c9145 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.171638 Jul 19 20:58:26.477653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 198/393] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:26 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:26.713577 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:26.714187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:26.721814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.722257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.723022 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:26.723451 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:26.865558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:26.873116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2fae01d2-d3f3-44c4-adcd-bac3f30e2998 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.163466 Jul 19 20:58:26.873678 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 196/394] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:26 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:27.353727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:27.354462 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:27.360605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.361168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.361944 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.362372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.495553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:27.497464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:27.499409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:27.504113 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.505188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.505672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.506115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.508779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-15d34864-0b14-40b1-a4af-8d9c9ee8e488 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.158866 Jul 19 20:58:27.513929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 199/395] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:27 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:27.655946 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:27.664997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1b2324b4-aa05-4e07-b55b-3be07b5c0cd8 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.173707 Jul 19 20:58:27.665582 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 197/396] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:27 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:27.890580 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:27.891079 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:27.897301 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.897755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:27.898509 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:27.898949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.034462 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:28.042053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5cbd99cd-0ff2-4ecc-9da7-74d4d6531f91 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.155444 Jul 19 20:58:28.043241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 200/397] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:27 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:28.526043 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:28.527402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:28.534019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:28.534464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.535239 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:28.535672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.673766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:28.681349 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a0d562ed-e35c-4324-9277-be349f1d6b04 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.159193 Jul 19 20:58:28.681909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 198/398] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:28 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:28.682621 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:28.683742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:28.693084 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:28.693534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.694340 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:28.694777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:28.853146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:28.862729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bc19340f-7caf-426e-8677-1e36e2209d21 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.183761 Jul 19 20:58:28.863432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 201/399] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:28 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:29.059683 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:29.060411 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:29.067733 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.068175 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.068983 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.069414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.207380 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:29.216568 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-736d6f94-ae9b-4816-87fc-7b946642703f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.160837 Jul 19 20:58:29.217193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 199/400] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:29 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:29.700156 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:29.700803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:29.702738 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:29.703516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=10 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:29.710389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.710836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.711722 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.712155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.853984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:29.862256 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-32afef1c-8d3d-477d-b341-59f5ad848893 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.166617 Jul 19 20:58:29.862879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 202/401] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:29 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:29.879107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:29.879628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:29.881576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:29.887710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.888148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:29.888933 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:29.889355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:30.023974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:30.037216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd662dbc-5d03-48b1-b4d5-5a74fa29c6a7 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1314 microversion: 2.1 time: 0.161785 Jul 19 20:58:30.038228 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 200/402] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:29 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:30.238485 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:30.239447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:30.247423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:30.247871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:30.248684 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:30.249122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:30.383756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:30.392544 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d061b01b-655d-4270-86c0-3cda2b4fba03 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.161953 Jul 19 20:58:30.399751 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 203/403] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:30 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:30.879019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:30.879631 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:30.886192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:30.886701 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:30.887439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:30.887850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.030473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:31.038804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-422d2fb7-1cd9-4e01-8c7a-6b5133dfb5f1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.163660 Jul 19 20:58:31.039375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 201/404] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:30 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:31.054359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:31.054960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:31.061265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.061707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.063142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.063142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.203479 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:31.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e3bace83-f073-40dc-a837-99991a804d58 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1498 microversion: 2.1 time: 0.160752 Jul 19 20:58:31.211777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 204/405] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:31 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:31.409948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:31.410557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:31.417145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.417586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.418361 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:31.418790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:31.557070 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:31.565633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f894a3e9-af56-4f5b-9066-f55c06e2e402 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.159307 Jul 19 20:58:31.566214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 202/406] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:31 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:32.055627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:32.056241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:32.063050 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.063471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.064426 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.064884 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.079903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:32.081090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:32.087805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.088253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.089074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.089514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.118883 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:58:32.226415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-39f590be-87b3-4f3c-9237-de6c14a86f65 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "DELETE /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 204 len: 0 microversion: 2.1 time: 0.149549 Jul 19 20:58:32.227251 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 203/407] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:58:32 2022] DELETE /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:58:32.231670 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:32.234505 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:32.242741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5e577704-a1bf-46ed-a488-7046805e6102 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.190865 Jul 19 20:58:32.244552 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 205/408] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:32 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:32.247754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:32.249149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:32.264133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.265066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.265843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.266435 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.410197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:32.420469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-41730569-bbf4-4c30-b042-ac24fedae913 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1504 microversion: 2.1 time: 0.182086 Jul 19 20:58:32.421408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 204/409] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:32 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:32.422628 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-457d4cf4-e182-4aad-bff3-147a1bbc55d0 req-47c49080-c14f-42d3-9d3f-cea347fd0ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a022283b-dc95-47f2-b901-60749e4a4887", "name": "network-vif-plugged", "status": "completed", "tag": "e9dcd1e3-1150-485d-b697-9689f41dbeaf"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:32.431448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-457d4cf4-e182-4aad-bff3-147a1bbc55d0 req-47c49080-c14f-42d3-9d3f-cea347fd0ace service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.431989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-457d4cf4-e182-4aad-bff3-147a1bbc55d0 req-47c49080-c14f-42d3-9d3f-cea347fd0ace service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.444275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-457d4cf4-e182-4aad-bff3-147a1bbc55d0 req-47c49080-c14f-42d3-9d3f-cea347fd0ace service nova] Creating event network-vif-plugged:e9dcd1e3-1150-485d-b697-9689f41dbeaf for instance a022283b-dc95-47f2-b901-60749e4a4887 on hv-cinder-74915 Jul 19 20:58:32.449744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-457d4cf4-e182-4aad-bff3-147a1bbc55d0 req-47c49080-c14f-42d3-9d3f-cea347fd0ace service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034018 Jul 19 20:58:32.450386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 206/410] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:58:32.583967 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:32.584504 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:32.591195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.591661 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.596455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:32.596455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:32.726716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:32.734938 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7c6ca0b0-9d47-4387-ada9-1257f931961a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.155182 Jul 19 20:58:32.735510 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 205/411] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:32 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:33.268216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.268940 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.275394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.275853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.277163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.277601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.428215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:33.436065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e3f17130-8fb7-41f6-9967-a67a8ce629a0 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.172004 Jul 19 20:58:33.436664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 207/412] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:33.437728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.438341 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.445206 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.445652 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.446423 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.446863 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.579691 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:33.587339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2a4aaecb-eddb-41d2-8fa2-2132c43a1a56 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1504 microversion: 2.1 time: 0.153412 Jul 19 20:58:33.588579 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 206/413] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:33.752294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:33.752926 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:33.758945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.759392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.760150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:33.760616 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:33.900227 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:33.908150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ed1e602d-38f1-4476-80ca-42c9aa2289b6 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.159749 Jul 19 20:58:33.908772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 208/414] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:33 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.452759 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.453387 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.459987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.460459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.461227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.461647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.593017 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.600302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-110e734f-328e-47a3-8f2d-408590b9320c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.151354 Jul 19 20:58:34.600891 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 207/415] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.608390 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.609006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.616261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.616261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.616705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.617106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.755443 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:34.763723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ebdcdcaa-da40-427e-9bb1-74173b468187 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1504 microversion: 2.1 time: 0.160761 Jul 19 20:58:34.764277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 209/416] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:34.924805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:34.925415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:34.932080 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.932559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:34.934195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:34.934744 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.069849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:35.079747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c3cdb638-3a50-42d3-b577-28141ecc4043 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.158717 Jul 19 20:58:35.080355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 208/417] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:34 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:35.617721 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:35.618342 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:35.624627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.625086 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.625869 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.626308 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.770464 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:35.778888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-77b6a8d6-1e09-46ff-9fe5-09af04e5bcd4 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.164986 Jul 19 20:58:35.779458 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 210/418] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:35 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:35.781537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:35.782180 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:35.789216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.789661 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.790454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:35.790915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:35.938010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:35.952192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a98fb989-cb1f-4033-a898-b417cb31287f tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1504 microversion: 2.1 time: 0.174670 Jul 19 20:58:35.953240 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 209/419] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:35 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:36.097058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:36.097665 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:36.103929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.104406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.105816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.106273 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.255934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:36.263783 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5a05c2ce-ecb2-4a49-b583-bede996049d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.170492 Jul 19 20:58:36.264379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 211/420] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:36 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:36.753583 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-44a373f0-08b4-49cf-bf93-bdf11ebd3483 req-09a9fb6c-e19a-4064-9ffd-7493f5ff705c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485", "name": "network-vif-deleted", "tag": "2e34ab60-de6c-4678-9b36-933ba3da1288"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:36.762578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-44a373f0-08b4-49cf-bf93-bdf11ebd3483 req-09a9fb6c-e19a-4064-9ffd-7493f5ff705c service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.763018 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-44a373f0-08b4-49cf-bf93-bdf11ebd3483 req-09a9fb6c-e19a-4064-9ffd-7493f5ff705c service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.773897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-44a373f0-08b4-49cf-bf93-bdf11ebd3483 req-09a9fb6c-e19a-4064-9ffd-7493f5ff705c service nova] Creating event network-vif-deleted:2e34ab60-de6c-4678-9b36-933ba3da1288 for instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 on hv-cinder-74915 Jul 19 20:58:36.779389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-44a373f0-08b4-49cf-bf93-bdf11ebd3483 req-09a9fb6c-e19a-4064-9ffd-7493f5ff705c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029547 Jul 19 20:58:36.779967 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 210/421] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:36.795053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:36.795689 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:36.801805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.802249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.803012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.803444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.937691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:36.945493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d921a55c-b7a9-4b0d-b521-39b60aa565dc tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.154281 Jul 19 20:58:36.946086 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 212/422] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:36 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:36.970585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:36.971312 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:36.979572 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.980016 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.980848 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:36.981283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:36.984059 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:37.049221 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:37.058236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-80632c43-89b3-4f2c-be2d-97df036a6ece tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1462 microversion: 2.1 time: 0.091158 Jul 19 20:58:37.058826 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 211/423] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:36 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:37.286475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:37.287033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:37.293795 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.294233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.295003 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.295430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.442770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:37.450643 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-146c4d94-b57f-4ae2-8f95-1e98eea61c2d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.168245 Jul 19 20:58:37.451221 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 213/424] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:37 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:37.962992 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:37.963589 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:37.970236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.970672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:37.971421 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:37.971845 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.078107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:38.078716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:38.085446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.085897 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.086698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.087122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.108854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:38.116148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a0312f1-058d-4004-bc6d-0ce039515ff1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1319 microversion: 2.1 time: 0.157001 Jul 19 20:58:38.116732 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 212/425] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:37 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:38.150204 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:38.158314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c21b4e16-0d61-4202-8d9c-0d86e986dbfe tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1462 microversion: 2.1 time: 0.083990 Jul 19 20:58:38.158881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 214/426] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:38 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:38.468176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:38.468721 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:38.474692 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.475125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.475882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:38.476334 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:38.609802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:38.617384 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f098827c-02b0-4a7e-9c39-db7b6484916f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.153648 Jul 19 20:58:38.617941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 213/427] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:38 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:39.133100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:39.133704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:39.140643 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.141089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.141852 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.142287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.175238 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:39.176083 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:39.183420 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.184003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.184865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.185361 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.260547 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:39.269863 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d9886d99-ec32-4273-b0fc-0e3af25a183d tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1299 microversion: 2.1 time: 0.098529 Jul 19 20:58:39.270446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 214/428] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:39 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:39.296040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:39.303489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-16ff686b-01c4-4110-b4eb-1c2c6ee2633a tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1508 microversion: 2.1 time: 0.174268 Jul 19 20:58:39.304044 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 215/429] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:39 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:39.320593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70a49436-c9c8-47ff-8d47-6b26c2d42d37", "device": "/dev/sdb"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:39.321689 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:39.328272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.328894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.329655 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.330079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.634575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:39.635292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:39.641467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.642613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.642977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:39.643388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:39.805585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:39.813752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3c8c7ab0-ef24-4419-b0e2-50d23da4542e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.183227 Jul 19 20:58:39.814416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 216/430] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:39 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:39.818475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eabc2edd-8af1-4598-8f50-6a1bad0251a8 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "POST /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501575 Jul 19 20:58:39.823517 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 215/431] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 20:58:39 2022] POST /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:40.286424 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:40.287084 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:40.293166 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.293614 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.294374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.294808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.326084 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.326527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.326973 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lazy-loading 'fault' on Instance uuid eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:40.370401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aaaf0bf8ee461c83350055d207951e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051e2bfc96334054956366e1308d067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:40.377997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a6a09117-6ed1-45b8-9fd2-770d3e0baa24 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 200 len: 1304 microversion: 2.1 time: 0.095300 Jul 19 20:58:40.378494 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 217/432] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:40 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:40.832945 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:40.833641 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:40.839942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.840419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.841189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:40.841623 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:40.975200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:40.983265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ddd20d7b-eafb-46fe-aa18-f54085724cbe tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.155296 Jul 19 20:58:40.983854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 216/433] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:40 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:41.396743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:41.397368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] [instance: eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:41.403527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:41.403974 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:41.404810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:41.405247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:41.419317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] HTTP exception thrown: Instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 could not be found. Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Request method failure captured: Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 HTTP/1.1 Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xquLy9aAeqSXZhcfltkOHRX--dl0XpZ-kBhKZqC45nt6NzXyYF7LYZktSBquWERwiARdylmbTDPcVfavmiNBUWj6AIOBCOQBqOEMzNw1dLaZw43CV0H1Fv9Pgtwwm0FmdfGCOBSoFvxWYSGEphe0SlzBziAOdYGLCcvDOXWu5jiFHQ Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 051e2bfc96334054956366e1308d067d Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesActionsTest-642907910 Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:58:41.421065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/051e2bfc96334054956366e1308d067d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/051e2bfc96334054956366e1308d067d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/051e2bfc96334054956366e1308d067d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_051e2bfc96334054956366e1308d067d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesActionsTest-642907910 Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 051e2bfc96334054956366e1308d067d Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesActionsTest-642907910 Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesActionsTest-642907910-project Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 72aaaf0bf8ee461c83350055d207951e Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesActionsTest-642907910-project Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 could not be found. Jul 19 20:58:41.422438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485'} Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 could not be found. Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:41.423414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 could not be found. Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 could not be found. Jul 19 20:58:41.424918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:58:41.431498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] Returning 404 to user: Instance eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:41.431498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-22a303a2-f683-4f0a-aded-20b00796c305 tempest-VolumesActionsTest-642907910 tempest-VolumesActionsTest-642907910-project] 10.222.0.85 "GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485" status: 404 len: 111 microversion: 2.1 time: 0.030098 Jul 19 20:58:41.431498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 218/434] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:41 2022] GET /compute/v2.1/servers/eae9b04e-4b3d-47d9-bf26-c1f1ff8e4485 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:58:42.000295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:42.001079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:42.007899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:42.008381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:42.009159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:42.009598 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:42.149705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:42.157416 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fc4ee77c-d585-43e3-b95e-b1b7cb66d0f4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.161004 Jul 19 20:58:42.157971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 217/435] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:41 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:43.174599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:43.175350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:43.181202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.181645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.182406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.183424 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.322206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:43.330128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-342e15a3-d74a-4a93-964c-d4fb801123e9 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1501 microversion: 2.1 time: 0.159354 Jul 19 20:58:43.330728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 219/436] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:43 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:43.346192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff39148-8ddd-45fa-aebf-61e96a8bb70b"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:43.347300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:43.353922 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.354938 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.355767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.356201 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.379708 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] HTTP exception thrown: Cannot 'attach_volume' instance e4180f91-4020-48ce-ad4c-be5c214df7e2 while it is in vm_state rescued Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Request method failure captured: Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/os-volume_attachments HTTP/1.1 Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 74 Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xqT9co5naxXFhA9K13IQga4rr_hUZX35aVEz2GGVsCoUCqXAjJBjJ2ivspknwRZQcTuQ1wooqOLTAVyzdDxD0xAct4gGNGWkTF5OlxYJzhc6hd3pQiKdDbTyEsPppLByfrxyn_ggwbUs37R21bPUbWmx5QcOloTSTm6AmC8LH8KBo8 Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: d5af714b14ba471980868293588841fd Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 20:58:43.381939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d5af714b14ba471980868293588841fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d5af714b14ba471980868293588841fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: d5af714b14ba471980868293588841fd Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: ac1b24e50c894dcf8e887275fd91a174 Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {"volumeAttachment": {"volumeId": "4ff39148-8ddd-45fa-aebf-61e96a8bb70b"}} Jul 19 20:58:43.383492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Cannot 'attach_volume' instance e4180f91-4020-48ce-ad4c-be5c214df7e2 while it is in vm_state rescued Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'server_id': 'e4180f91-4020-48ce-ad4c-be5c214df7e2', 'body': {'volumeAttachment': {'volumeId': '4ff39148-8ddd-45fa-aebf-61e96a8bb70b'}}} Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:58:43.384342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e4180f91-4020-48ce-ad4c-be5c214df7e2 while it is in vm_state rescued Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:58:43.385511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e4180f91-4020-48ce-ad4c-be5c214df7e2 while it is in vm_state rescued Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Returning 409 to user: Cannot 'attach_volume' instance e4180f91-4020-48ce-ad4c-be5c214df7e2 while it is in vm_state rescued {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-aa1c6886-9c47-4b01-9ee8-8e5b5bfaba69 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041107 Jul 19 20:58:43.386665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 218/437] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 20:58:43 2022] POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 20:58:43.392603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:43.393155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:43.399864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.400320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.401122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.401560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.424932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-349900169", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897274336", "security_groups": [{"name": "tempest-secgroup-smoke-1746131802"}], "block_device_mapping_v2": [{"uuid": "ef1c8849-e519-404b-8896-cf2114f91a46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2a1cb6e-5ef1-4fb9-b7b1-7ad9aeec34c4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:43.472688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f4c1419b-34b6-46bb-95e8-a370092fe6de tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/action" status: 202 len: 0 microversion: 2.1 time: 0.083524 Jul 19 20:58:43.478015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 220/438] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 20:58:43 2022] POST /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:58:43.485265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:43.485265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:43.492059 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.492724 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.493670 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:43.494160 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:43.580110 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] validate_networks() for [('f2a1cb6e-5ef1-4fb9-b7b1-7ad9aeec34c4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:58:43.941263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:43.949275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ce346665-544e-40de-a19f-f5ad402dbf9b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.469677 Jul 19 20:58:43.949844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 221/439] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:43 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:44.224638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:58:44.225062 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:58:44.225540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:58:44.225950 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:58:44.226359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:58:44.235136 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:44.235905 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:44.236833 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:44.237337 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:44.253936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for project e08c8f78187d474a865ea712616685cc. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:58:44.257881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for user 5634da4012cc4d468f84409736c28e09 and project e08c8f78187d474a865ea712616685cc. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:58:44.315601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:58:44.317772 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef1c8849-e519-404b-8896-cf2114f91a46',volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:58:44.450331 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-933b8dd3-3068-4be5-99b6-544fd20a2cae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.029185 Jul 19 20:58:44.451306 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 219/440] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:58:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:58:44.461476 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a948f1f5-cb7a-40d1-ac5b-efaf665dde12 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:44.462164 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a948f1f5-cb7a-40d1-ac5b-efaf665dde12 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:44.521543 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a948f1f5-cb7a-40d1-ac5b-efaf665dde12 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:44.528008 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a948f1f5-cb7a-40d1-ac5b-efaf665dde12 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1093 microversion: 2.1 time: 0.070578 Jul 19 20:58:44.528604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 222/441] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:44 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:44.966887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:44.967488 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:44.973747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:44.974187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:44.974948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:44.975375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:45.101530 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:45.110696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e1ea8cf8-55f8-4828-8346-a6cf023fc7d5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.147794 Jul 19 20:58:45.111272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 220/442] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:44 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:45.545074 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:45.545756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:45.551893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:45.552358 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:45.553124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:45.553562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:45.568683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:45.619576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:45.627007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-926e7a61-108c-4070-ba69-06bc50d7cdeb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1143 microversion: 2.1 time: 0.085778 Jul 19 20:58:45.627565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 223/443] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:45 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:46.127806 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:46.128685 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:46.135273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:46.136407 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:46.137163 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:46.137587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:46.278155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:46.286038 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a9dca663-1820-4cad-9248-32221a85d419 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.162137 Jul 19 20:58:46.286650 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 221/444] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:46 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:46.643907 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:46.644615 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:46.650675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:46.651124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:46.652433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:46.652859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:46.722240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:46.731183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a195aa38-a71e-4564-8db7-827ca5564822 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1143 microversion: 2.1 time: 0.091219 Jul 19 20:58:46.731731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 224/445] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:46 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:47.305318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:47.305951 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:47.313633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:47.314080 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:47.314884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:47.315564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:47.452497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:47.460828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-57eb5b10-4c03-40e4-8b09-d2a9ee9feb0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.159219 Jul 19 20:58:47.461640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 222/446] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:47 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:47.751530 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:47.752090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:47.758575 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:47.759015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:47.759813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:47.760525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:47.831115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:47.838654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a64c5ae0-ae80-4588-9a14-7fd5d110876a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1191 microversion: 2.1 time: 0.094397 Jul 19 20:58:47.839252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 225/447] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:47 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:48.478446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:48.478998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:48.485577 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:48.486019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:48.486785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:48.487216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:48.665297 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:48.674102 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-33e740e2-4bb7-4b56-97f2-872b09d9d97e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.199468 Jul 19 20:58:48.675014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 223/448] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:48 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:48.854923 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:48.855518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:48.861750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:48.862189 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:48.862966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:48.863388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:48.927240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:48.935628 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e0658df6-15d7-4c38-b8af-340d1fc600fa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1209 microversion: 2.1 time: 0.084446 Jul 19 20:58:48.936188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 226/449] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:48 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:49.695270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:49.695994 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:49.707130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.707302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.709083 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.710456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.953698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:49.954543 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:49.965628 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.966450 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:49.968546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:49.969139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.014598 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:50.029727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-31a6db2e-7a82-4820-893b-26a7ecbec534 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.340414 Jul 19 20:58:50.041194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 224/450] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:49 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:50.163862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:50.172068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b79d4682-d8cd-42cb-b034-b33bf430f422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.222185 Jul 19 20:58:50.172671 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 227/451] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:49 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:50.780017 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:50.780971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:50.788062 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.788765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.789703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.790144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.805259 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:50.806139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:50.819335 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.819782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.820596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:50.821035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:50.842106 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2d1aca34-c61c-49f3-a19e-58fceb985ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/ips" status: 200 len: 148 microversion: 2.1 time: 0.065843 Jul 19 20:58:50.850457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 225/452] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 20:58:50 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/ips => generated 148 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:50.857268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c7622828-5959-4d67-a3af-15f1306bb633 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/ips" status: 200 len: 151 microversion: 2.20 time: 0.055701 Jul 19 20:58:50.864031 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 228/453] 10.222.0.85 () {60 vars in 1288 bytes} [Tue Jul 19 20:58:50 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 20:58:51.050282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:51.051393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:51.067659 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:51.068540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:51.069394 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:51.069869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:51.197872 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:51.199491 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:51.255333 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:51.257107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:51.259616 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:51.260198 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:51.502104 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:51.515465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6216f21d-992a-49ff-9d46-e7433afb2d1d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.469859 Jul 19 20:58:51.516519 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 226/454] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:51 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:51.559261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:51.570171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5105560c-529d-4fde-89fd-5a703eb52c96 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.378081 Jul 19 20:58:51.581092 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 229/455] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:51 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:52.533596 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:52.534313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:52.541098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.541540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.542893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.543319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.589218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:52.589825 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:52.596347 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.596813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.597577 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:52.598006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:52.755689 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:52.761080 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:52.775861 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2bd1601e-ce48-4cee-93c6-78075858f67f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.245983 Jul 19 20:58:52.778328 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 227/456] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:52 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:52.791647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:52.801060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-789b71a4-2b49-4d6f-bb93-b4a9efe42e20 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.216058 Jul 19 20:58:52.801906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 230/457] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:52 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:53.795718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:53.796358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:53.799075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:53.805804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:53.806240 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:53.807012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:53.808002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:53.819510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:53.820148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:53.828874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:53.829523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:53.830723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:53.831793 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:54.050757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:54.055250 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:54.058574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8778b97f-d10a-41f5-9c45-11da89da3fb3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.267585 Jul 19 20:58:54.059124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 228/458] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:53 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:54.063142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-60c2f2f9-437a-4a9c-9f2c-278ac1022516 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.248463 Jul 19 20:58:54.063717 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 231/459] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:53 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:55.077732 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:55.078407 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:55.080836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:55.082085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:55.083566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:55.084413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=6 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:55.087783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.087979 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:55.088399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.088732 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=82 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:55.090044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.090176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.090578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.090733 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.091590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:55.091987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:55.349048 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:55.357646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-935043d6-d184-46e8-9cbf-3be0b9a64817 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.280899 Jul 19 20:58:55.358216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 232/460] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:55 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:55.373756 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:55.382450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fb9e8bc5-0cc8-4d21-9c18-69fdaadb26d2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1509 microversion: 2.1 time: 0.309036 Jul 19 20:58:55.383357 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 229/461] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:55 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:56.018452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a926754d-a275-4f2a-bd44-651d99a6b939"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:56.019871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:56.028250 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.028930 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.030062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.030647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.377916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:56.379743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:56.387347 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.388052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.389094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.389724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.632431 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:56.642001 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d83e0d16-9578-4a11-9479-6d1576706624 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.270251 Jul 19 20:58:56.653321 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 230/462] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:56 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:56.660894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:56.661703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:56.670328 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.671236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.672415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:56.673228 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:56.954974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:56.966535 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6f5bfa06-2013-4f92-9b68-dde8beedd2b5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1515 microversion: 2.1 time: 0.311625 Jul 19 20:58:56.987287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 231/463] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:56 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1515 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:58:57.188998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-2484fb32-daa9-4ffd-905b-39375982128a req-6ca686fc-8299-4ac5-aab6-fce4387673c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13be579c-9ae8-4e74-9d8f-5dd6d6202c42", "tag": "24a941e2-60b0-493d-a0ce-2834b56f93e1"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:57.205265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-2484fb32-daa9-4ffd-905b-39375982128a req-6ca686fc-8299-4ac5-aab6-fce4387673c0 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:57.214613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-2484fb32-daa9-4ffd-905b-39375982128a req-6ca686fc-8299-4ac5-aab6-fce4387673c0 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:57.229851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-2484fb32-daa9-4ffd-905b-39375982128a req-6ca686fc-8299-4ac5-aab6-fce4387673c0 service nova] Creating event network-changed:24a941e2-60b0-493d-a0ce-2834b56f93e1 for instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 on hv-cinder-74915 Jul 19 20:58:57.245592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-2484fb32-daa9-4ffd-905b-39375982128a req-6ca686fc-8299-4ac5-aab6-fce4387673c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060550 Jul 19 20:58:57.249840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 232/464] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:58:57.660728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:57.661451 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:57.668155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:57.668608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:57.669366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:57.669788 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:57.809356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:57.817234 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-62a657c2-d77d-44e3-870b-06ead41f75c3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.161171 Jul 19 20:58:57.817797 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 233/465] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:57 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:57.996126 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:58:57.996682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:58.002960 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.003406 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.004171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.004629 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.027880 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lazy-loading 'flavor' on Instance uuid 318211d6-3f74-4f53-bfd8-0a10d7272b05 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:58:58.284070 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2efa1d91-986a-4d5c-89ed-3accaf09e3c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/action" status: 202 len: 0 microversion: 2.20 time: 0.291738 Jul 19 20:58:58.284730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 234/466] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jul 19 20:58:57 2022] POST /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:58:58.293184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:58.293995 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:58.306889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.307335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.308108 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.308587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.462347 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:58.471271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:58.472768 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:58.473913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ebebfad0-9f28-4f94-bfb3-c04a9059f969 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.184846 Jul 19 20:58:58.474468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 235/467] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:58 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:58:58.834545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:58.835222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:58.841576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.842018 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.842774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:58.843198 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:58.976715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:58.984843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-afb317b8-1819-4062-82e6-7d3c08937625 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.154287 Jul 19 20:58:58.985406 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 236/468] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:58 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:58:59.492452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:58:59.493050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:58:59.499236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:59.499680 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:59.500474 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:58:59.500903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:58:59.640618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:59.648496 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:59.650012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:58:59.651712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e5c52231-c4b8-43d4-8309-a255087e4116 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.162604 Jul 19 20:58:59.652261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 237/469] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:58:59 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:00.002051 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:00.002751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:00.009275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:00.009715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:00.010474 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:00.010907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:00.139501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:00.146869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0ded3ab2-bb81-45b2-9fed-87febf51e7e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.148738 Jul 19 20:59:00.147457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 238/470] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:58:59 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:00.669675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:00.670265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:00.676280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:00.676754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:00.677499 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:00.677919 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:00.813523 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:00.821701 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:00.823832 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:00.825055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-827601b8-fee8-4a8d-9343-8e9fd9a62a44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.159303 Jul 19 20:59:00.825613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 239/471] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:00 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:01.116381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-244411f3-5c1a-4548-89be-c1c33cc9aedc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.102418 Jul 19 20:59:01.122305 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 233/472] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 20:58:56 2022] POST /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments => generated 194 bytes in 5105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:59:01.175404 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:01.176170 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:01.186699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.187711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.189640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.190848 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.420137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:01.428825 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-90a23c0a-8fd2-47ef-96df-0ae728004fd4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1277 microversion: 2.1 time: 0.265201 Jul 19 20:59:01.429878 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 240/473] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:01 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:01.849126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:01.851722 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:01.860733 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.861461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:01.862429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:01.863022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.096714 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:02.105833 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:02.107587 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:02.109009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-29b6b08e-4f62-4d01-9644-6937f72631de tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.267447 Jul 19 20:59:02.109740 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 234/474] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:01 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:02.447696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:02.449055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:02.456972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.457619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.458484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:02.459030 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:02.733839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:02.765309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-77f3ce70-a23d-403d-adf7-b07f9f4ae76e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.306824 Jul 19 20:59:02.773759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a9c020d3-f1c0-4e35-9f8d-69335efcdf76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'create', calling method: .version_select at 0x7f125f64c040>, body: {"keypair": {"name": "tempest-keypair-1721467139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaiLjt1W4fghykMrxPwaOnlpg1pCdPcRsE/ShthQ4n6790xcwTnul08CNf/feBPwvkn2kQ8AsmQZQ+fiaEmxw2shkUH2zkQ1r8ZP3j7KCatXSJeV9zLoYo4UuJy1WDPew=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:02.789478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 241/475] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:02 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:02.805226 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-a9c020d3-f1c0-4e35-9f8d-69335efcdf76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for project d5af714b14ba471980868293588841fd. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:02.810455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-a9c020d3-f1c0-4e35-9f8d-69335efcdf76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for user ac1b24e50c894dcf8e887275fd91a174 and project d5af714b14ba471980868293588841fd. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:02.842438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a9c020d3-f1c0-4e35-9f8d-69335efcdf76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072358 Jul 19 20:59:02.844186 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 235/476] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 20:59:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:59:03.127783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:03.128455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:03.134898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:03.135484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:03.136479 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:03.136962 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:03.327622 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:03.337798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:03.339637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:03.340976 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a1af0102-01fe-4ce9-b7b1-47be412f19f0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.217714 Jul 19 20:59:03.341657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 242/477] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:03 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:03.798119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:03.798837 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:03.810153 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:03.810886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:03.811850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:03.812392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:04.086051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:04.097954 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-54a1d01a-98a2-408e-b3bf-36952eeed668 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.304359 Jul 19 20:59:04.104686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 236/478] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:03 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:04.359104 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:04.362106 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:04.372526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:04.373339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:04.374154 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:04.374593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:04.384860 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:04.623314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:04.640213 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:04.644673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:04.648796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-07415161-c253-4206-b182-5c0087cb314c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.292564 Jul 19 20:59:04.649989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 243/479] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:04 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:04.748775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-124544234", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e45be69-2346-4883-ae4c-d926b2ce64cf"}], "security_groups": [{"name": "tempest-securitygroup--459614542"}], "key_name": "tempest-keypair-1721467139", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:05.123363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:05.124380 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:05.134889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.135764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.135922 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] validate_networks() for [('8e45be69-2346-4883-ae4c-d926b2ce64cf', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:59:05.136770 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.137305 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.371270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:05.386176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c6fcb0a8-066e-43b0-9889-06a30209888c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.267527 Jul 19 20:59:05.388458 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 244/480] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:05 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:05.671130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:05.671764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:05.678922 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:59:05.679835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.679986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:59:05.680092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.680439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.681185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:59:05.681185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:59:05.681766 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:59:05.682267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.699800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.700260 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.701194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:05.701757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:05.728171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for project d5af714b14ba471980868293588841fd. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:05.732746 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Getting quotas for user ac1b24e50c894dcf8e887275fd91a174 and project d5af714b14ba471980868293588841fd. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:05.747137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:59:05.750053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:59:05.831379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c5f49421-d9cd-4911-8a1b-308b331b72c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.081899 Jul 19 20:59:05.832205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 237/481] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:59:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:59:05.842706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a7cd1f80-c42b-4d2c-b427-fd903e3d98e8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:05.843311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a7cd1f80-c42b-4d2c-b427-fd903e3d98e8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:05.863947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:05.872775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:05.874836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:05.876245 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-397f7a61-b89c-4cc2-a6d2-28f884f02987 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.209622 Jul 19 20:59:05.877058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 245/482] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:05 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:05.924577 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a7cd1f80-c42b-4d2c-b427-fd903e3d98e8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:05.932041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a7cd1f80-c42b-4d2c-b427-fd903e3d98e8 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1245 microversion: 2.1 time: 0.093689 Jul 19 20:59:05.932704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 238/483] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:05 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:06.178099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:06.179088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:06.188535 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.189325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.190171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.191185 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.391705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lazy-loading 'services' on Instance uuid a022283b-dc95-47f2-b901-60749e4a4887 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:06.406756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:06.408171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:06.415728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.417133 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.418162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.418958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.529514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3c6b7d6f-d41f-4f8a-8bd9-86bc6791ca95 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887/os-volume_attachments/70a49436-c9c8-47ff-8d47-6b26c2d42d37" status: 202 len: 0 microversion: 2.1 time: 0.357514 Jul 19 20:59:06.533573 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 246/484] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 20:59:06 2022] DELETE /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887/os-volume_attachments/70a49436-c9c8-47ff-8d47-6b26c2d42d37 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 20:59:06.658902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:06.668054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a3af065f-0953-4f76-aa0d-c4974eeb03a9 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.268112 Jul 19 20:59:06.668868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 239/485] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:06 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:06.897902 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:06.899033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:06.906180 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.906636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.907422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.907889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.955643 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:06.959627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:06.971928 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.972701 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:06.973501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:06.974089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:07.071145 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:07.080090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5395980b-3a4e-4def-bd3f-ae2e9702c85a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1297 microversion: 2.1 time: 0.134218 Jul 19 20:59:07.091723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 240/486] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:06 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1297 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:07.101779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:07.111119 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:07.112949 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:07.114146 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b70930e5-7086-4e17-b18b-649e0d9c8a96 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.220949 Jul 19 20:59:07.114908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 247/487] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:06 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:07.689548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:07.691129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:07.703069 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:07.711005 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:07.712043 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:07.712686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.003298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:08.006000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:08.017911 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cb04c346-2aef-4f47-a837-bbcf78efa2ab tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.335964 Jul 19 20:59:08.019141 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 241/488] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:07 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:08.099774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:08.101372 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:08.108850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:08.109627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.111000 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:08.111645 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.136245 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:08.137119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:08.150372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:08.151731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.154221 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:08.155011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:08.249547 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:08.260803 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-67b8f24d-8a2b-440b-8495-bc2cafaacc37 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1303 microversion: 2.1 time: 0.165638 Jul 19 20:59:08.262208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 248/489] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:08 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:08.384212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:08.396663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:08.398409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:08.399769 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-24284bb5-9add-43df-852d-4b2822e7e4b1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.269078 Jul 19 20:59:08.426379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 242/490] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:08 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:09.037116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:09.037736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:09.046590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:09.047871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:09.048743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:09.049244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:09.279508 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:09.280821 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:09.287516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:09.287884 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:09.288705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:09.289362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:09.384647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:09.394876 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-362c293b-382b-4663-ae41-3195dc4f888d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.363092 Jul 19 20:59:09.397115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 249/491] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:09 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:09.423734 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:09.424677 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:09.433324 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:09.433770 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:09.434818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:09.435420 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:09.658481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:09.683732 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-67594ae2-c1f9-437a-ba67-84cd141e3d6f tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.408743 Jul 19 20:59:09.692492 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 243/492] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:09 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:09.798879 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:09.821657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:09.822234 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:09.833684 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-54fd61f4-6bd4-4dd1-900c-64c3b24282ec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.412750 Jul 19 20:59:09.850347 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 250/493] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:09 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:10.114616 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-f6ac8953-20b0-4acd-8ca6-fb99d55c2ba4 req-a8a85b14-2206-4df5-8ba5-8e0bed4a325e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd76a68e-63b0-4834-8f93-3768570ff8d4", "tag": "57db9dc8-d4a7-44fe-8eb7-411c2a063b4d"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:10.133391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-f6ac8953-20b0-4acd-8ca6-fb99d55c2ba4 req-a8a85b14-2206-4df5-8ba5-8e0bed4a325e service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.134096 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-f6ac8953-20b0-4acd-8ca6-fb99d55c2ba4 req-a8a85b14-2206-4df5-8ba5-8e0bed4a325e service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:10.156289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-f6ac8953-20b0-4acd-8ca6-fb99d55c2ba4 req-a8a85b14-2206-4df5-8ba5-8e0bed4a325e service nova] Creating event network-changed:57db9dc8-d4a7-44fe-8eb7-411c2a063b4d for instance cd76a68e-63b0-4834-8f93-3768570ff8d4 on hv-cinder-74915 Jul 19 20:59:10.165167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-f6ac8953-20b0-4acd-8ca6-fb99d55c2ba4 req-a8a85b14-2206-4df5-8ba5-8e0bed4a325e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053709 Jul 19 20:59:10.170731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 244/494] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:10.413469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:10.414757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:10.422010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.422765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:10.423793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.424484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:10.582724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:10.590787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ee17f4f6-c26a-4060-9635-55ad6d1989b7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.181268 Jul 19 20:59:10.591674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 251/495] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:10 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:10.703980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:10.704812 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:10.711402 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.711854 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:10.712663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.713613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:10.851902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:10.858406 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:10.859090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:10.864046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f7b61936-91b7-4b58-b2ba-1f684cafeab0 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.163879 Jul 19 20:59:10.866048 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.866199 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 245/496] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:10 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:10.866555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:10.867646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:10.868286 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:11.045858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:11.055364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:11.057267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:11.062891 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8515c3c4-453e-4442-b667-989bd467a63d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.208633 Jul 19 20:59:11.064186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 252/497] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:10 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:11.609063 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:11.609650 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:11.616221 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:11.616691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:11.617462 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:11.618089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:11.786181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:11.794016 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3cfa2774-38a8-4c33-8ee5-ad47a075d6c2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.188735 Jul 19 20:59:11.794600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 246/498] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:11 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:11.882885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:11.883464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:11.891148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:11.891598 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:11.892394 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:11.892829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:12.082536 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:12.083141 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:12.095511 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:12.096283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:12.097267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:12.097919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:12.125314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:12.135988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c0a7fcdd-f3dc-4396-9f3f-0c81100b2b97 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.256279 Jul 19 20:59:12.137502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 253/499] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:11 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:12.230718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f8967bec-74d8-4d19-bf63-d7b8bd023745 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: .version_select at 0x7f125f4cf9d0>, body: {"keypair": {"name": "tempest-keypair-1538199776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaxN023jHKj2QUgdbJyQKC5uS2/CWS1lJmNzSHzUM13K88k5vkYKEpOfSxyxKb3oVv2mZuMBRezMJW3BlQaPS8WtCBkDs5Z13hjCd9GQl3d4ZLTO8SJBW3OlvMaldnHXw=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:12.257953 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-f8967bec-74d8-4d19-bf63-d7b8bd023745 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:12.264243 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-f8967bec-74d8-4d19-bf63-d7b8bd023745 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:12.311697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f8967bec-74d8-4d19-bf63-d7b8bd023745 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095809 Jul 19 20:59:12.312972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 254/500] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 20:59:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:59:12.399066 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:12.409915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:12.411962 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:12.414479 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2b9016f8-8ad7-4687-b189-eafef71ccd3a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.335525 Jul 19 20:59:12.415724 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 247/501] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:12 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:12.812786 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:12.813567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:12.828729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:12.829531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:12.830520 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:12.831121 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.088818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:13.099847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e8425bed-75d7-4a5f-9f8b-f921dca6a82b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.292440 Jul 19 20:59:13.100863 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 255/502] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:12 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:13.153889 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.153889 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:13.165403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.166695 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.167599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.168110 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.286292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.286784 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:13.293688 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.294132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.294930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.295356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.324115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:59:13.330860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:13.339171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c6e1a63e-603c-4151-a5cb-11d9b5601ae3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.189480 Jul 19 20:59:13.339770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 248/503] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:13.409175 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-92515da2-a997-4381-9cb2-b977fbc7965e tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 204 len: 0 microversion: 2.1 time: 0.126379 Jul 19 20:59:13.410066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 256/504] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:13 2022] DELETE /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 20:59:13.418852 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.419455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:13.425874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.426312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.427108 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.427538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.435206 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:13.436230 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:13.444526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.445103 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.445904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:13.446365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:13.635735 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:13.643080 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:13.645460 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-63719dac-7ae1-48fa-810e-f3a4025b8772 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1514 microversion: 2.1 time: 0.231175 Jul 19 20:59:13.646269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 249/505] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:13.651774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:13.653385 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:13.654553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f372eed0-5280-4c48-a012-d57cb691d23a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.224458 Jul 19 20:59:13.655202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 257/506] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:13 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:14.112910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1509395961", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96395a07-97fe-40fb-bf6f-dcb0f6511ee1"}], "security_groups": [{"name": "tempest-securitygroup--825213852"}], "key_name": "tempest-keypair-1538199776", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:14.116502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:14.117116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:14.126105 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.126653 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.127529 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.128082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.144451 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:14.305675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] validate_networks() for [('96395a07-97fe-40fb-bf6f-dcb0f6511ee1', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:59:14.369100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:14.378200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d8889c33-0d1e-4a13-b3b8-1ac797bf837b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.265177 Jul 19 20:59:14.380349 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 258/507] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:14 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:14.387606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:14.388618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:14.395448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.396158 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.397897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.401021 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.617127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:14.626230 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2b1742ff-65b9-48f4-bfc6-6e06f268f1e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.243969 Jul 19 20:59:14.626805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 259/508] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:14 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:14.663201 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:14.663926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:14.673382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.674069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.675174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.675413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.874662 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:59:14.875077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:59:14.875543 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:59:14.875981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:59:14.876461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:59:14.886019 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.886511 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.887308 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.887791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.895205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:14.903871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fb7bc2ab-451b-4e8a-840d-e7229fc41d56 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1514 microversion: 2.1 time: 0.244442 Jul 19 20:59:14.904381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 260/509] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:14 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:14.916939 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:14.917149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:14.917149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:14.917441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:14.917610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.917610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.918141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:14.918573 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:14.926197 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:59:14.929028 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:59:14.993342 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-25d38c5d-57d9-4d78-9e77-7c9526682a48 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.884666 Jul 19 20:59:14.993996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 250/510] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:59:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 20:59:15.004608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1d98829f-cd1b-4fe0-a503-dd7e07edd925 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:15.005361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1d98829f-cd1b-4fe0-a503-dd7e07edd925 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:15.073258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1d98829f-cd1b-4fe0-a503-dd7e07edd925 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:15.082609 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1d98829f-cd1b-4fe0-a503-dd7e07edd925 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1242 microversion: 2.1 time: 0.081785 Jul 19 20:59:15.083555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 251/511] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:14 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:15.106744 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:15.115630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:15.117191 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:15.118590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bee1d230-bb4e-4735-b97a-0f5a0069130b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.213180 Jul 19 20:59:15.119293 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 261/512] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:14 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:15.397350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:15.398048 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:15.405685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.406233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:15.407087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.407448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:15.539360 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:15.547867 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0bb761e8-2159-4313-bcf1-d70078e24af7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.154399 Jul 19 20:59:15.548461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 252/513] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:15 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:15.643751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:15.644378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:15.650446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.650889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:15.651641 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.652074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:15.787916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:15.796958 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-61681dda-a87e-4ec8-aca4-fbcfcec22f94 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.156903 Jul 19 20:59:15.797540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 262/514] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:15 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:15.848901 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-3b3c51b8-1f81-4ada-a5e2-e82a5a334211 req-b726058f-d331-4f69-860e-2a8e0021bdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13be579c-9ae8-4e74-9d8f-5dd6d6202c42", "name": "network-vif-plugged", "status": "completed", "tag": "24a941e2-60b0-493d-a0ce-2834b56f93e1"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:15.858643 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3b3c51b8-1f81-4ada-a5e2-e82a5a334211 req-b726058f-d331-4f69-860e-2a8e0021bdd7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.859168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-3b3c51b8-1f81-4ada-a5e2-e82a5a334211 req-b726058f-d331-4f69-860e-2a8e0021bdd7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:15.873741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-3b3c51b8-1f81-4ada-a5e2-e82a5a334211 req-b726058f-d331-4f69-860e-2a8e0021bdd7 service nova] Creating event network-vif-plugged:24a941e2-60b0-493d-a0ce-2834b56f93e1 for instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 on hv-cinder-74915 Jul 19 20:59:15.879570 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-3b3c51b8-1f81-4ada-a5e2-e82a5a334211 req-b726058f-d331-4f69-860e-2a8e0021bdd7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Jul 19 20:59:15.880493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 253/515] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:15.931386 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:15.931955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:15.938985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.939434 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:15.940207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:15.940948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.101870 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:16.102568 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:16.109624 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.110075 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.110853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.111429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.189466 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.200252 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1a3d068f-1da2-4ad6-8ed3-1e21c90ef25c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1514 microversion: 2.1 time: 0.273921 Jul 19 20:59:16.202311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 263/516] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:15 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:16.218536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:16.219258 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:16.228947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.229702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.230850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.231494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.466471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.475015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e5223e85-14fa-4e9d-a61f-d517052fb80f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1246 microversion: 2.1 time: 0.377328 Jul 19 20:59:16.475810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 254/517] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:16 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1246 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:16.565816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:16.566421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:16.573218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.573647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.574422 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.574855 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.680195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.689325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.691259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.692608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a7176f29-7d64-4a52-a698-abb7c5e657aa tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.489144 Jul 19 20:59:16.693508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 264/518] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:16 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:16.814449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:16.816013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:16.822226 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.822663 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.824013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:16.824466 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:16.845018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.853831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eacd6024-aada-4296-a2e0-ebd9a1138c8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.291963 Jul 19 20:59:16.854415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 255/519] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:16 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:16.979522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:16.992063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4e222192-e32b-4ef0-a7bf-21d1b9b4bf0a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.181818 Jul 19 20:59:16.992699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 265/520] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:16 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:17.219633 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:17.220102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:17.231921 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.232598 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.233554 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.234159 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.374635 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:17.382559 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-084a0306-32d1-4ad5-aafa-4cf6e36d2ece tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1514 microversion: 2.1 time: 0.166822 Jul 19 20:59:17.383110 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 256/521] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:17 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:17.492244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:17.492989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:17.499451 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.499893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.500860 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.501118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.562960 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:17.571784 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cf477dac-2923-4b22-8853-77e0cfe245ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1238 microversion: 2.1 time: 0.083396 Jul 19 20:59:17.572416 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 266/522] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:17 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:17.713474 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:17.714076 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:17.723417 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.723871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.724671 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.725097 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.877878 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:17.878829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:17.891901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.892624 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.893589 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:17.896206 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:17.897334 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:17.905309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:17.907292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:17.908514 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-26529a8f-a468-464a-986a-a0d254c13850 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.198842 Jul 19 20:59:17.919556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 257/523] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:17 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:18.010131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.021878 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.038004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.038729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.039670 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.040276 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.057043 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:18.066826 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cd8f5f40-ab4e-4777-9cf8-82f3075fea0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.194233 Jul 19 20:59:18.076862 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 267/524] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:17 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:18.208793 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:18.219359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-13f709fa-8d44-4ed2-b294-be3ae32bf325 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.213641 Jul 19 20:59:18.220890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 258/525] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:18 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:18.400978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.402255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.410998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.411531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.412820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.413968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.585489 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:18.590249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.590839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.592816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:18.600545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-972f26c4-adf1-4a16-8b17-9c7e18ca3c67 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1514 microversion: 2.1 time: 0.201226 Jul 19 20:59:18.600741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.600741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.600741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.600741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.601064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 268/526] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:18 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:18.667849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:18.675831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-876987fa-1cc3-4073-bbab-8c1664ab75f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1238 microversion: 2.1 time: 0.090832 Jul 19 20:59:18.676488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 259/527] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:18 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:18.927162 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:18.927805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:18.949992 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.950749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:18.951697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:18.952184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.084164 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:19.084806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:19.089482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.092052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.092532 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.093442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.093880 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.097881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.099366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.100550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-db42add2-4314-4fc1-891d-f50cec10b43d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.177347 Jul 19 20:59:19.101108 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 269/528] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:18 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:19.230546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.237793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:19.238399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:19.238658 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-347b1181-3f5a-458c-8d63-d03c4908f8e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.158399 Jul 19 20:59:19.239232 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 260/529] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:19 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:19.240503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:19.246649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.247081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.248550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.248550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.383635 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:19.391244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-94496245-5221-4726-9fca-ef33bb38443b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.157168 Jul 19 20:59:19.391840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 270/530] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:19 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:19.613929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:19.614528 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:19.622561 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1418855850", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:19.623115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.623288 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.624053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:19.624950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:19.641467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:19.676813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] validate_networks() for None {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 20:59:20.017106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.026163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c5ffa66d-1fbe-4415-8b32-d2732963c533 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1514 microversion: 2.1 time: 0.415410 Jul 19 20:59:20.036372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 261/531] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:19 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:20.041251 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.041883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.048850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.050142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.051123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.051561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.091517 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 20:59:20.092003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 20:59:20.092581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 20:59:20.093084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 20:59:20.093813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 20:59:20.106274 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.106274 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.107052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.107538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.124292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.126559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Getting quotas for project fc584a9767e74858979d7963227d7ada. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 20:59:20.131848 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Getting quotas for user a42ee6d51d5149ba91477623a358e26a and project fc584a9767e74858979d7963227d7ada. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 20:59:20.137303 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f8939274-ea71-479f-9af5-03d196cb9fd3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1302 microversion: 2.1 time: 0.108855 Jul 19 20:59:20.137998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 262/532] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:20.145023 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 20:59:20.147828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 20:59:20.157046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.157666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.181666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.182243 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.183311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.183832 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.222438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cf3de6fd-0de9-41be-b73e-9a780888c013 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604167 Jul 19 20:59:20.223365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 271/533] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 20:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 20:59:20.236906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b38b42d2-8356-4b13-a9e7-01cdfe30dc9b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.237528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b38b42d2-8356-4b13-a9e7-01cdfe30dc9b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.343930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b38b42d2-8356-4b13-a9e7-01cdfe30dc9b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.361442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b38b42d2-8356-4b13-a9e7-01cdfe30dc9b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1215 microversion: 2.1 time: 0.129210 Jul 19 20:59:20.362073 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 272/534] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:20.379465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.380424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.387979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.388716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.390118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.390774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.425713 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.445266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.450656 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.454216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2c451d37-83ae-461b-91a1-2d92686952b0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.314178 Jul 19 20:59:20.455728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 263/535] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:20.473793 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-577cab78-9c17-4a11-94ba-dda31272ba9d req-08212b7c-a039-476e-b74a-0650091e219d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a022283b-dc95-47f2-b901-60749e4a4887", "name": "network-vif-deleted", "tag": "e9dcd1e3-1150-485d-b697-9689f41dbeaf"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:20.482742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-577cab78-9c17-4a11-94ba-dda31272ba9d req-08212b7c-a039-476e-b74a-0650091e219d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.483368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-577cab78-9c17-4a11-94ba-dda31272ba9d req-08212b7c-a039-476e-b74a-0650091e219d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.505777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-577cab78-9c17-4a11-94ba-dda31272ba9d req-08212b7c-a039-476e-b74a-0650091e219d service nova] Creating event network-vif-deleted:e9dcd1e3-1150-485d-b697-9689f41dbeaf for instance a022283b-dc95-47f2-b901-60749e4a4887 on hv-cinder-74915 Jul 19 20:59:20.512686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-577cab78-9c17-4a11-94ba-dda31272ba9d req-08212b7c-a039-476e-b74a-0650091e219d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045904 Jul 19 20:59:20.513289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 264/536] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:20.522011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:20.522779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:20.541632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.542988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.543988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.544681 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.560920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.570246 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-24d2d6cb-fbe5-4510-ab4c-1338eb2a7662 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.196850 Jul 19 20:59:20.571578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 273/537] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:20.577700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-2760bf82-1e5e-420a-ae13-563804eda102 req-014ddeed-2901-4a96-befe-7204763ae4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd76a68e-63b0-4834-8f93-3768570ff8d4", "name": "network-vif-plugged", "status": "completed", "tag": "57db9dc8-d4a7-44fe-8eb7-411c2a063b4d"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:20.593716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-2760bf82-1e5e-420a-ae13-563804eda102 req-014ddeed-2901-4a96-befe-7204763ae4c5 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:20.594558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-2760bf82-1e5e-420a-ae13-563804eda102 req-014ddeed-2901-4a96-befe-7204763ae4c5 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:20.640473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-2760bf82-1e5e-420a-ae13-563804eda102 req-014ddeed-2901-4a96-befe-7204763ae4c5 service nova] Creating event network-vif-plugged:57db9dc8-d4a7-44fe-8eb7-411c2a063b4d for instance cd76a68e-63b0-4834-8f93-3768570ff8d4 on hv-cinder-74915 Jul 19 20:59:20.648765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-2760bf82-1e5e-420a-ae13-563804eda102 req-014ddeed-2901-4a96-befe-7204763ae4c5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075425 Jul 19 20:59:20.650342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 274/538] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:20.733154 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:20.740951 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-406821c6-e0e5-40f9-8531-5b94585c7cff tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.223268 Jul 19 20:59:20.741678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 265/539] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:20 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:21.048057 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.048797 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.055758 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.056205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.057008 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.057442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.155418 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.156005 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.164218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.164582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.165352 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.165792 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.309682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.318147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-50620c47-6eca-4af8-8e74-353146fed4ea tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1304 microversion: 2.1 time: 0.275113 Jul 19 20:59:21.318718 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 275/540] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1304 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:21.355329 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.362886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d3da9d0d-a936-4e92-95bd-d12a7a324e23 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1302 microversion: 2.1 time: 0.211251 Jul 19 20:59:21.363452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 266/541] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1302 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:21.381506 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.382150 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.389260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.389694 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.390701 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.390882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.454907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.463604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-87af8c64-9e94-446e-8064-68e21124fe7b tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1219 microversion: 2.1 time: 0.087569 Jul 19 20:59:21.464170 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 276/542] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:21.474957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.475554 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.485496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.486226 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.487180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.487622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.589288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.589898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.597185 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.597627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.598402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.598936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.617687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:21.628264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.639960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.641488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.642661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-02e192e4-b4b0-4dd0-acbc-da43660d7783 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.171634 Jul 19 20:59:21.643226 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 267/543] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:21.745019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.756416 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c692d46d-8574-4e79-8b12-03dd35c7668c tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1265 microversion: 2.1 time: 0.170624 Jul 19 20:59:21.757351 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 277/544] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:21.759952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:21.760611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:21.766899 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.767349 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.768112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:21.768902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:21.906571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:21.914235 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a1b8ddf8-a758-42ba-945d-05d076fc0225 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.158721 Jul 19 20:59:21.914800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 268/545] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:21 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:22.340253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:22.340950 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:22.348765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.349862 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.351406 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.352362 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.383178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:22.385579 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:22.392093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.393130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.395487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.397053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.403026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.403465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.403985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lazy-loading 'fault' on Instance uuid a022283b-dc95-47f2-b901-60749e4a4887 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:22.458731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.472453 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5e4b3165-0187-46e2-aaa3-afe171e1b2f6 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1309 microversion: 2.1 time: 0.138601 Jul 19 20:59:22.473063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 278/546] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:22 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:22.480701 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:22.481390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:22.487954 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.488568 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.490422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.490422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.491072 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.501148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ac60868f-ce15-497b-9c98-b1fc1f8622b8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1300 microversion: 2.1 time: 0.124633 Jul 19 20:59:22.502193 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 269/547] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:22 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:22.564747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.573559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5ee8fadf-4454-4f96-9ec0-af33823d1a89 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1211 microversion: 2.1 time: 0.096559 Jul 19 20:59:22.574125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 279/548] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:22 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:22.662592 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:22.663090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:22.669419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.669868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.670633 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.671067 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.774645 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:22.777440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:22.785353 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.786638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.788702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.789409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.829070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.842875 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.844542 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:22.845994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-27d44001-6bd2-4f46-a84f-9671b9a6aa79 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.187633 Jul 19 20:59:22.847158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 270/549] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:22 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:22.938417 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:22.939185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:22.948911 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.951679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.952864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:22.957217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:22.990020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.002664 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-922bf141-0738-4f0f-ace0-e350bb364370 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1449 microversion: 2.1 time: 0.232247 Jul 19 20:59:23.004920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 280/550] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:22 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1449 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:23.019816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:23.020454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:23.026832 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.027278 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.028056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.028525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.145666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.155398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d2d56f47-4ef7-456b-b1d8-4db98b26ad51 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.228133 Jul 19 20:59:23.156803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 271/551] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:22 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:23.195989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.204478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3e1bae12-ebd4-4e0d-b6f4-89a2ead0e5ad tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1449 microversion: 2.1 time: 0.188519 Jul 19 20:59:23.205286 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 281/552] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:23 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1449 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:23.490759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:23.492183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:23.500073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.500699 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.501550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.502051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.524058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:23.524923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:23.534963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.536177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.537824 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.538999 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.541784 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.542240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.543139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lazy-loading 'fault' on Instance uuid a022283b-dc95-47f2-b901-60749e4a4887 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:23.655978 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.664578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fe496111-0931-4d58-87cd-a5cc2cadc82c tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1309 microversion: 2.1 time: 0.177750 Jul 19 20:59:23.675519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 272/553] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:23 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:23.680758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:23.681985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:23.688645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.689455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.690733 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.691619 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.791905 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.799550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9fd372b9-44de-40c8-b519-108f77af19f7 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1267 microversion: 2.1 time: 0.122770 Jul 19 20:59:23.800583 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 273/554] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:23 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:23.860661 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:23.867778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:23.868757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:23.871367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d0e6b1ed-c200-4ebf-9b37-a3385c813fee tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.354913 Jul 19 20:59:23.881786 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 282/555] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:23 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:23.882022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.882022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:23.882022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:23.882022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.094392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.110114 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.112639 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.114103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2a0291fd-17a9-4d53-a146-bb6881b910c8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.253367 Jul 19 20:59:24.115571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 274/556] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:23 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:24.173296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:24.173896 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:24.180650 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.182064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.183068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.183719 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.303361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-5d2e5c48-3df0-421d-a2dc-c4069ce5195a req-a4cc8de3-286b-4d59-b3cc-2f1dbacbc6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e084f98-237c-4483-b3e7-67e1dda82279", "tag": "77bc4dfa-07e0-4c98-90a9-7dc01129cdc5"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:24.336130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5d2e5c48-3df0-421d-a2dc-c4069ce5195a req-a4cc8de3-286b-4d59-b3cc-2f1dbacbc6b6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.336776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5d2e5c48-3df0-421d-a2dc-c4069ce5195a req-a4cc8de3-286b-4d59-b3cc-2f1dbacbc6b6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.358696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-5d2e5c48-3df0-421d-a2dc-c4069ce5195a req-a4cc8de3-286b-4d59-b3cc-2f1dbacbc6b6 service nova] Creating event network-changed:77bc4dfa-07e0-4c98-90a9-7dc01129cdc5 for instance 1e084f98-237c-4483-b3e7-67e1dda82279 on hv-cinder-74915 Jul 19 20:59:24.366941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-5d2e5c48-3df0-421d-a2dc-c4069ce5195a req-a4cc8de3-286b-4d59-b3cc-2f1dbacbc6b6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070810 Jul 19 20:59:24.368129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 275/557] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:24.477074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.498839 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be8d1ab8-3642-4bf4-967f-b22b877f0f88 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.329284 Jul 19 20:59:24.500561 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 283/558] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:24 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:24.515594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-76ad7515-fed7-40e9-8931-fb06378afa0e req-96a0d6ec-af63-4e3e-8751-364d1267c969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "name": "network-vif-plugged", "status": "completed", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:24.539361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-76ad7515-fed7-40e9-8931-fb06378afa0e req-96a0d6ec-af63-4e3e-8751-364d1267c969 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.540057 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-76ad7515-fed7-40e9-8931-fb06378afa0e req-96a0d6ec-af63-4e3e-8751-364d1267c969 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.552393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-76ad7515-fed7-40e9-8931-fb06378afa0e req-96a0d6ec-af63-4e3e-8751-364d1267c969 service nova] Creating event network-vif-plugged:be0016f3-966e-4341-aec7-fa313f2a1024 for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 on hv-cinder-74915 Jul 19 20:59:24.558320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-76ad7515-fed7-40e9-8931-fb06378afa0e req-96a0d6ec-af63-4e3e-8751-364d1267c969 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046981 Jul 19 20:59:24.560373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 276/559] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:24.683534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:24.684287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:24.691377 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.691819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.692644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.693260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.725289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.725654 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.726101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lazy-loading 'fault' on Instance uuid a022283b-dc95-47f2-b901-60749e4a4887 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:24.780236 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.788132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-922f7a62-1d63-420e-b149-c6f7a59773e3 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1309 microversion: 2.1 time: 0.110074 Jul 19 20:59:24.788766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 284/560] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:24 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:24.818425 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:24.819117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:24.826067 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.826519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.827299 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.827777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.889462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:24.890084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:24.897094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.897230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:24.897683 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.898547 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:24.899075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:24.899517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:24.907795 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fbf345f2-860e-4195-ba94-e8ce04f1e05e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1275 microversion: 2.1 time: 0.093624 Jul 19 20:59:24.908644 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 277/561] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:24 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:25.133070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:25.133683 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:25.135599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=20 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:25.141812 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.142266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.143051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.143499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.143601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:25.152055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-176ebab2-a472-4c34-bf81-532051743bd7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.266451 Jul 19 20:59:25.152971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 285/562] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:24 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:25.516426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:25.517060 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:25.523070 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.523509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.524281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.524737 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.631326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:25.642194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:25.644437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:25.646139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a907f02e-6fc6-4c9b-ad1b-05c7b3a07f7f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.517251 Jul 19 20:59:25.656228 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 278/563] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:25 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:25.770658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:25.778040 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c211c826-cbf4-4d60-8bf8-0fe110216e60 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1370 microversion: 2.1 time: 0.265549 Jul 19 20:59:25.778611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 286/564] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:25 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:25.808516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:25.813074 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:25.828374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.829219 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.832283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.833029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.909601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.910237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.910912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lazy-loading 'fault' on Instance uuid a022283b-dc95-47f2-b901-60749e4a4887 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:25.915548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:25.927000 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:25.927808 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:25.935107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.935677 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:25.936757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:25.937428 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.021151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483b27bfe5674a528c29a15a054cc617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c814e2b46244db93e801a78763d880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.029111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-874e78da-bb41-40c9-be7e-2ce3ad27a3a1 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 200 len: 1309 microversion: 2.1 time: 0.226842 Jul 19 20:59:26.029678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 279/565] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:25 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:26.043324 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.052859 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dc3a7c6b-6733-4bfc-9c95-cfac2b170a2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1273 microversion: 2.1 time: 0.131218 Jul 19 20:59:26.053923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 287/566] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:25 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:26.156364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-30544ed8-3f44-4eca-9a9d-b500c4dbdf37 req-856de70c-7d46-4600-a6b7-07fc307530a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13be579c-9ae8-4e74-9d8f-5dd6d6202c42", "tag": "24a941e2-60b0-493d-a0ce-2834b56f93e1"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:26.166394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-30544ed8-3f44-4eca-9a9d-b500c4dbdf37 req-856de70c-7d46-4600-a6b7-07fc307530a0 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.166984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-30544ed8-3f44-4eca-9a9d-b500c4dbdf37 req-856de70c-7d46-4600-a6b7-07fc307530a0 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.172508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:26.172508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:26.177556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.178004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.178784 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.179221 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.179371 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-30544ed8-3f44-4eca-9a9d-b500c4dbdf37 req-856de70c-7d46-4600-a6b7-07fc307530a0 service nova] Creating event network-changed:24a941e2-60b0-493d-a0ce-2834b56f93e1 for instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 on hv-cinder-74915 Jul 19 20:59:26.184941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-30544ed8-3f44-4eca-9a9d-b500c4dbdf37 req-856de70c-7d46-4600-a6b7-07fc307530a0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032352 Jul 19 20:59:26.185716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 280/567] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:26.320645 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.328798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-64bc3a70-7024-4c63-9206-b170e0606fde tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.163195 Jul 19 20:59:26.329879 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 288/568] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:26 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:26.667018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:26.667915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:26.678642 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.679185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.680032 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.680605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.795066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:26.796169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:26.811700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.816709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.818766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:26.820220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:26.963565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.974277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.977496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:26.978934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-31c4f3b4-8e14-4c59-a4fa-130ffc90a778 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.318395 Jul 19 20:59:26.980274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 281/569] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:26 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:27.046379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.047182 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] [instance: a022283b-dc95-47f2-b901-60749e4a4887] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.057920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.058663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.059549 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.060663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.091648 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] HTTP exception thrown: Instance a022283b-dc95-47f2-b901-60749e4a4887 could not be found. Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Request method failure captured: Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 HTTP/1.1 Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xo0fW5uNajeKcrwRjDAp4s4t0k3H_w2c302ho3Zxp4B3fUtVpVTKiid-KXFU2JMCn61_uOEAXYTmfmPLh2Bb2ZmgFWiY54WdSuwn0PM6tTetdyeKwBbm-nxLv4-g1ulACFs58W1WDbTHDS5_1qSxAK73YYI5vnIdhCudxMeHOJBt1o Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 72c814e2b46244db93e801a78763d880 Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1699061878 Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 20:59:27.096429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72c814e2b46244db93e801a78763d880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/72c814e2b46244db93e801a78763d880"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/72c814e2b46244db93e801a78763d880"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_72c814e2b46244db93e801a78763d880"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesSnapshotTestJSON-1699061878 Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 72c814e2b46244db93e801a78763d880 Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1699061878 Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesSnapshotTestJSON-1699061878-project Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 483b27bfe5674a528c29a15a054cc617 Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesSnapshotTestJSON-1699061878-project Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance a022283b-dc95-47f2-b901-60749e4a4887 could not be found. Jul 19 20:59:27.097774 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'a022283b-dc95-47f2-b901-60749e4a4887'} Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a022283b-dc95-47f2-b901-60749e4a4887 could not be found. Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:27.098531 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a022283b-dc95-47f2-b901-60749e4a4887 could not be found. Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a022283b-dc95-47f2-b901-60749e4a4887 could not be found. Jul 19 20:59:27.099800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 20:59:27.110163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] Returning 404 to user: Instance a022283b-dc95-47f2-b901-60749e4a4887 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:27.111192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-660090a2-b8c6-4d0b-9a0d-b8fa755eed07 tempest-VolumesSnapshotTestJSON-1699061878 tempest-VolumesSnapshotTestJSON-1699061878-project] 10.222.0.85 "GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887" status: 404 len: 111 microversion: 2.1 time: 0.068948 Jul 19 20:59:27.111775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 282/570] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/a022283b-dc95-47f2-b901-60749e4a4887 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:27.123614 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.124425 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.132947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.133395 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.134158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.134917 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.210364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:27.225888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-92981872-f332-407f-912c-c2971c784e49 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1564 microversion: 2.1 time: 0.434215 Jul 19 20:59:27.240013 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:27.242279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 289/571] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:26 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1564 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:27.250202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.250892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.253273 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8b269951-072e-4d00-be91-818de914f6f5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1273 microversion: 2.1 time: 0.139034 Jul 19 20:59:27.260447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 283/572] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:27.268632 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.274075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.275348 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.275799 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.346488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.347102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:27.354673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.360419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.361265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:27.361786 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:27.518167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ce3eb824-4217-4042-9c80-5bb13ac8bc07 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274371 Jul 19 20:59:27.518757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 290/573] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:27.790562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:27.798959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1dde0478-fa25-46b9-85e9-3ad5af772b89 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.456783 Jul 19 20:59:27.799887 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 284/574] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:27.998359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:27.998973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.006881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.007320 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.008105 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.009431 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.276112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:28.276752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.283359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.283728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.284558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.284996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.330998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:28.340223 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:28.341987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:28.343941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b52e5479-192e-4387-a4fc-3a3c969feb61 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.349953 Jul 19 20:59:28.344225 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 291/575] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:27 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:28.786551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:28.794344 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-60b6b261-0f67-4f91-a481-c2e51349dc24 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.523331 Jul 19 20:59:28.795212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 285/576] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:28 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:28.817842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:28.818087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:28.825044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.825486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:28.826376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:28.826691 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.060354 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.068532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-01cde8aa-c0ec-497c-80ca-75cd26efc8d0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.255889 Jul 19 20:59:29.069113 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 292/577] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:28 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:29.233967 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-31ed970d-683a-4610-bbc5-04396a975286 req-70fa641f-06ee-476d-aeaf-5008085fd084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd76a68e-63b0-4834-8f93-3768570ff8d4", "tag": "57db9dc8-d4a7-44fe-8eb7-411c2a063b4d"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:29.242268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-31ed970d-683a-4610-bbc5-04396a975286 req-70fa641f-06ee-476d-aeaf-5008085fd084 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.242708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-31ed970d-683a-4610-bbc5-04396a975286 req-70fa641f-06ee-476d-aeaf-5008085fd084 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.254795 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-31ed970d-683a-4610-bbc5-04396a975286 req-70fa641f-06ee-476d-aeaf-5008085fd084 service nova] Creating event network-changed:57db9dc8-d4a7-44fe-8eb7-411c2a063b4d for instance cd76a68e-63b0-4834-8f93-3768570ff8d4 on hv-cinder-74915 Jul 19 20:59:29.259633 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-31ed970d-683a-4610-bbc5-04396a975286 req-70fa641f-06ee-476d-aeaf-5008085fd084 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029624 Jul 19 20:59:29.260455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 286/578] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 20:59:29.361893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.362619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.368626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.369127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.369895 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.370318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.501987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.504155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:29.511211 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.512709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.513854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e72d8ed2-1fd2-49ca-a27b-6af6d1810951 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.155946 Jul 19 20:59:29.514411 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 293/579] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:29 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:29.822491 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:29.823291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:29.833174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.834261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.835877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:29.836546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:29.984357 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:29.995302 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7d823586-6244-41c9-b87c-764906214587 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.187271 Jul 19 20:59:29.996029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 287/580] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:29 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:30.084974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:30.085504 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:30.092548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.093006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.093846 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.094286 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.117533 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:30.238096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.246514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-62f0ba3f-fc8d-49d1-805c-7101baa25902 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.165508 Jul 19 20:59:30.247096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 294/581] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:30 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:30.532628 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:30.533249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:30.539367 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.539810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.540604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:30.541041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:30.676391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.685034 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.686593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:30.687797 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-42916de3-fc1d-48ce-ad63-58982b62251d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.159181 Jul 19 20:59:30.688376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 288/582] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:30 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:31.019315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:31.019915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:31.022132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=12 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:31.027538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.027975 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.028842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.029267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.161431 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:31.169428 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f11dbb30-d83a-4f61-8795-6ac482366180 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.154385 Jul 19 20:59:31.170020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 295/583] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:31 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:31.375373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:31.376028 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:31.384167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.385181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.385968 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.386408 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.528237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:31.536093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-38c1d188-aaa7-4e86-afee-7e8c937f9235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.276486 Jul 19 20:59:31.536605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 289/584] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:31 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:31.706968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:31.707565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:31.714269 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.714757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.715512 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:31.715975 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:31.844821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:31.852762 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:31.854415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:31.855575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2ea66146-ffce-4f52-aea7-fbae15746661 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.152537 Jul 19 20:59:31.856134 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 296/585] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:31 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:32.187015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:32.187620 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:32.193903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:32.194375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:32.195133 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:32.195562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:32.326882 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:32.334694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-029f8bc8-3923-48f1-9445-52bf2024a4d5 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.151200 Jul 19 20:59:32.335257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 290/586] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:32 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:32.553056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:32.553592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:32.560682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:32.561133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:32.561926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:32.562357 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:32.700842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:32.708449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cb241404-8919-42c3-96b9-14e8fd4eff2c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.159375 Jul 19 20:59:32.709019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 297/587] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:32 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:32.874903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:32.875494 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:32.881560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:32.882015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:32.882798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:32.883259 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.015711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:33.023627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:33.025653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:33.026844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-513a0dd4-ec78-4697-b7c7-94d1c63fca60 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.156127 Jul 19 20:59:33.027396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 291/588] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:32 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:33.351892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:33.352533 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:33.358662 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.359120 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.359869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.360296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.494827 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:33.502231 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dfbe42f6-cd5a-4dfa-b9aa-e0c5f89113f6 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.154144 Jul 19 20:59:33.502792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 298/589] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:33 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:33.725581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:33.726187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:33.733726 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.734210 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.735081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:33.735432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:33.868041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:33.875537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-aad1f304-a073-4139-91e1-395f8f2ecb51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.153790 Jul 19 20:59:33.876163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 292/590] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:33 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:34.045682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:34.046281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:34.053049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.053490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.054242 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.054672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.185281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:34.193785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:34.195262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:34.196435 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9944e98d-9832-4f7d-83d9-80980c12a47a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.155367 Jul 19 20:59:34.197644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 299/591] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:34 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:34.519487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:34.520087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:34.526925 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.527376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.528124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.528582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.662407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:34.669765 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5b26858d-4a40-4c16-8726-f17a5beb4b11 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.154210 Jul 19 20:59:34.670382 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 293/592] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:34 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:34.892455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:34.893058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:34.899091 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.899532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:34.900287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:34.900765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:35.032732 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:35.043623 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-29ab1ad8-9228-4afd-886e-084ee17d2e95 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.154760 Jul 19 20:59:35.054343 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 300/593] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:34 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:35.217414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:35.218351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:35.225765 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:35.226232 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:35.227216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:35.227834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:35.523201 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:35.536446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:35.539551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:35.541903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-333e9afe-23fd-48e3-bcd8-4b57b887ddab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.329135 Jul 19 20:59:35.542469 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 294/594] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:35 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:35.686866 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:35.687713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:35.695058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:35.695452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:35.696199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:35.697346 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:35.896566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:35.905173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c878f60a-256e-4442-9646-f5e29c27c5f4 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.222066 Jul 19 20:59:35.906420 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 301/595] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:35 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:36.016049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-88491565-d3ce-4075-abe1-20f85db40628 req-6a6dce43-ca50-401d-a17c-7958d339e6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993d6851-aea9-4d75-beba-89e5a32d3c36", "tag": "7af13dc1-1cd7-4c79-bcf4-3158e79a491f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:36.026943 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-88491565-d3ce-4075-abe1-20f85db40628 req-6a6dce43-ca50-401d-a17c-7958d339e6e9 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.027569 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-88491565-d3ce-4075-abe1-20f85db40628 req-6a6dce43-ca50-401d-a17c-7958d339e6e9 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.063903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:36.065141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:36.072039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.072794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.074264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.074859 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.078077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-88491565-d3ce-4075-abe1-20f85db40628 req-6a6dce43-ca50-401d-a17c-7958d339e6e9 service nova] Creating event network-changed:7af13dc1-1cd7-4c79-bcf4-3158e79a491f for instance 993d6851-aea9-4d75-beba-89e5a32d3c36 on hv-cinder-74915 Jul 19 20:59:36.087046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-88491565-d3ce-4075-abe1-20f85db40628 req-6a6dce43-ca50-401d-a17c-7958d339e6e9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074194 Jul 19 20:59:36.092317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 295/596] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:36.332641 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:36.343977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1d5c8d32-09c3-4c9c-8a73-6a8e1862d778 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.284356 Jul 19 20:59:36.344746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 302/597] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:36 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:36.561261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:36.563675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:36.575118 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.575791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.576627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.577367 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.727808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:36.736895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:36.738389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:36.739555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-499e8a23-8931-4ecf-821d-459256c5f3d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.183351 Jul 19 20:59:36.740107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 296/598] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:36 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:36.918749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-681a494e-8ca7-494c-a1b3-712c1801661b req-8b27360a-4675-45bd-9be6-b39ad9d63951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e084f98-237c-4483-b3e7-67e1dda82279", "name": "network-vif-plugged", "status": "completed", "tag": "77bc4dfa-07e0-4c98-90a9-7dc01129cdc5"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:36.923517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:36.924442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:36.927928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-681a494e-8ca7-494c-a1b3-712c1801661b req-8b27360a-4675-45bd-9be6-b39ad9d63951 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.928485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-681a494e-8ca7-494c-a1b3-712c1801661b req-8b27360a-4675-45bd-9be6-b39ad9d63951 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.932119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.932709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.933610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:36.934398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:36.944159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-681a494e-8ca7-494c-a1b3-712c1801661b req-8b27360a-4675-45bd-9be6-b39ad9d63951 service nova] Creating event network-vif-plugged:77bc4dfa-07e0-4c98-90a9-7dc01129cdc5 for instance 1e084f98-237c-4483-b3e7-67e1dda82279 on hv-cinder-74915 Jul 19 20:59:36.949345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-681a494e-8ca7-494c-a1b3-712c1801661b req-8b27360a-4675-45bd-9be6-b39ad9d63951 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035615 Jul 19 20:59:36.950990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 303/599] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:37.086320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:37.095148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e477a070-f8a0-4641-a94e-fcd6a47d3e6d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.175866 Jul 19 20:59:37.095724 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 297/600] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:36 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:37.362381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:37.362999 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:37.369937 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:37.370382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:37.371184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:37.371674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:37.509010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:37.516741 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-893c9868-1a2d-49e2-8e00-3a11a359a235 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.158676 Jul 19 20:59:37.517313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 304/601] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:37 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:37.761151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:37.761856 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:37.769036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:37.769597 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:37.770699 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:37.771059 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:38.031049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:38.033438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:38.040497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:38.042796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:38.044151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5416934f-55f7-4d0e-ba92-e7ce46b1b4a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.287003 Jul 19 20:59:38.044737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 298/602] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:37 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:38.111842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:38.112475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:38.119687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:38.120130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:38.120927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:38.121355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:38.251814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:38.259436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2bafd03b-20be-46e8-bf4f-b2e35106e76d tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.151422 Jul 19 20:59:38.259997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 305/603] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:38 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:38.534181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:38.534742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:38.541517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:38.541972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:38.542734 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:38.543165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:38.678309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:38.685731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f1ddeb46-e856-4ff2-864c-1f862c4e5eb0 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.155438 Jul 19 20:59:38.686281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 299/604] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:38 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:39.062961 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:39.063578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:39.070388 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.070852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.071746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.072538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.219529 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:39.227550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:39.229106 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:39.230265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-726e0b5a-c319-4e08-8301-db3074c403eb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.171210 Jul 19 20:59:39.230821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 306/605] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:39 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:39.276404 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:39.277029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:39.283464 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.283981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.284813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.285284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.424692 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:39.432735 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-00d8de84-feb0-4f76-8afa-134a27dc7be9 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.160211 Jul 19 20:59:39.433298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 300/606] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:39 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:39.703615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:39.704251 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:39.710253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.710694 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.711445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:39.711873 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:39.850745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:39.858245 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d00e1ef4-7d55-4f35-aab9-ce64ce49c9ac tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.158664 Jul 19 20:59:39.858806 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 307/607] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:39 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:40.249626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.250221 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:40.256728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:40.257167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:40.257929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:40.258357 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:40.390892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:40.399079 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:40.400613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:40.401917 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f47cc92f-5ec9-4685-8345-e6a3398eee18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.156133 Jul 19 20:59:40.402590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 301/608] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:40 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:40.449856 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.450463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:40.457350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:40.457788 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:40.458545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:40.458970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:40.589709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:40.597558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2531fd53-0062-4d0d-87e2-a81b682bd8cc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.151574 Jul 19 20:59:40.598122 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 308/609] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:40 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:40.875286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:40.875796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:40.882038 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:40.882484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:40.883245 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:40.883698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.012977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:41.020262 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c8c874c4-4897-47e1-bc9b-e09f2b9fd8e1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.148825 Jul 19 20:59:41.020860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 302/610] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:40 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:41.421104 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:41.421710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:41.427947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:41.428426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.429197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:41.429630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.567967 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:41.575767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:41.577269 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:41.578488 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c0ffc92b-8a92-4547-ab9d-3f18d168f129 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.161344 Jul 19 20:59:41.579035 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 309/611] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:41 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:41.614887 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:41.615486 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:41.622023 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:41.622470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.623233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:41.623669 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:41.755730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:41.763651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c0b7f70f-883a-4432-9431-5201d5808675 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.152571 Jul 19 20:59:41.764210 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 303/612] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:41 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:42.037977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:42.038587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:42.040592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:42.046427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.046867 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.047636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.048062 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.186494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:42.194561 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5956fc74-f304-4cf5-9c97-e56c2a8a2fb9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.160423 Jul 19 20:59:42.195068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 310/613] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:42 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:42.597631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:42.598142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:42.604127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.604608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.605402 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.605838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.737178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:42.745610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:42.747429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:42.748893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c7a92e20-e799-49cf-b22c-f757b6c0e649 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1744 microversion: 2.20 time: 0.155190 Jul 19 20:59:42.749757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 304/614] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:42 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:42.781265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:42.781855 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:42.788339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.788795 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.789559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:42.789991 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:42.792737 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:42.925462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:42.934025 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2c418ba8-74fe-40fc-b2a3-92ac4e15ae2f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.156521 Jul 19 20:59:42.934612 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 311/615] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:42 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:43.213406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:43.213941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:43.220206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.220691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.221461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.221888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.356202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:43.363791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f2098e11-a201-4927-8bad-7ce6cac11f6d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.155155 Jul 19 20:59:43.364381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 305/616] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:43 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:43.768384 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:43.768911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:43.775605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.776051 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.776846 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.777282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.909490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:43.918115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:43.919601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:43.920783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b742e289-0081-4654-a837-db6a0a14930a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.156403 Jul 19 20:59:43.921345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 312/617] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:43 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:43.951409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:43.952033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:43.958478 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.958922 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:43.959679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:43.960174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.099897 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:44.107762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-86498901-0c42-45c1-9c33-fd3e885a4aff tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.160032 Jul 19 20:59:44.108387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 306/618] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:43 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:44.383273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:44.383956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:44.391457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.392154 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.393005 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.393436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.554446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:44.564877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a78c41b-4349-420b-aef9-0d49eb6345fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.187610 Jul 19 20:59:44.578110 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 313/619] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:44 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:44.940179 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:44.940985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:44.947351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:44.950112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.951030 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:44.952041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:44.953585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.128564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:45.130049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:45.138264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:45.139049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.141495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:45.142580 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.503451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:45.515009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:45.516973 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:45.518039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:45.519303 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5231f972-a794-4717-9b66-f39567fd6d2c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.583027 Jul 19 20:59:45.520139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 307/620] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:44 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:45.531184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9c3d1c40-cf11-4499-b51b-ac996a658e2e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.403965 Jul 19 20:59:45.531184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 314/621] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:45 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:45.588277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:45.589581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:45.597086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:45.597086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.598376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:45.599120 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:45.754449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:45.769007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9edd601e-1bed-4100-b6c4-88f423c37245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1367 microversion: 2.1 time: 0.186764 Jul 19 20:59:45.769599 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 315/622] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:45 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:46.435103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-b41e82a2-d2b1-4db0-baf3-b992485a01ad req-fe13a7a4-5d3d-4ab3-9bf9-b11f322560e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d6851-aea9-4d75-beba-89e5a32d3c36", "name": "network-vif-plugged", "status": "completed", "tag": "7af13dc1-1cd7-4c79-bcf4-3158e79a491f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:46.448792 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-b41e82a2-d2b1-4db0-baf3-b992485a01ad req-fe13a7a4-5d3d-4ab3-9bf9-b11f322560e3 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.449622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-b41e82a2-d2b1-4db0-baf3-b992485a01ad req-fe13a7a4-5d3d-4ab3-9bf9-b11f322560e3 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.464842 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-b41e82a2-d2b1-4db0-baf3-b992485a01ad req-fe13a7a4-5d3d-4ab3-9bf9-b11f322560e3 service nova] Creating event network-vif-plugged:7af13dc1-1cd7-4c79-bcf4-3158e79a491f for instance 993d6851-aea9-4d75-beba-89e5a32d3c36 on hv-cinder-74915 Jul 19 20:59:46.470820 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-b41e82a2-d2b1-4db0-baf3-b992485a01ad req-fe13a7a4-5d3d-4ab3-9bf9-b11f322560e3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Jul 19 20:59:46.472205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 308/623] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:46.540874 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.544096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:46.544796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.545677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:46.559624 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.561105 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.561360 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.561572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.562398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.562850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.563231 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.564407 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.758467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:46.767196 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-070cf1ab-2a59-4268-918f-ee8743aa2783 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.227977 Jul 19 20:59:46.768291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 309/624] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:46 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:46.788192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.791851 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:46.804655 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.805574 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.807493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:46.808165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:46.825387 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:46.834541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:46.836527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:46.838575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f19b2c93-8874-405d-bcc9-acaa0d33f038 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.303427 Jul 19 20:59:46.839606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 316/625] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:46 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:46.960984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:46.970549 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c9ca3c05-038b-4702-a2fd-4032f5c9a2c4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1557 microversion: 2.1 time: 0.186891 Jul 19 20:59:46.971836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 310/626] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:46 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1557 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 20:59:46.988712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:46.989561 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:47.007022 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.007389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.008383 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.009025 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.117092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b749cc8b-c7a8-4655-bd0c-3b03ad4c8065 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133619 Jul 19 20:59:47.118663 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 317/627] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 20:59:46 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:47.795034 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:47.807965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:47.822861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.824169 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.826009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.828423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.865971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:47.869589 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:47.888503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.889196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:47.890199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:47.890644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.092038 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:48.103599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-591af0a3-d246-4201-9e12-48c521f03093 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.315156 Jul 19 20:59:48.103599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 311/628] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:47 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:48.135987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:48.145834 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:48.147513 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:48.149061 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-477607fd-9688-42cd-a52d-283c32d8001d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.294563 Jul 19 20:59:48.150458 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 318/629] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:47 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:48.746245 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-6896656a-4c96-4180-b15f-b80110b747fa req-e17c8d52-2b04-47d4-94e2-6560fde80441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e084f98-237c-4483-b3e7-67e1dda82279", "tag": "77bc4dfa-07e0-4c98-90a9-7dc01129cdc5"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:48.757737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6896656a-4c96-4180-b15f-b80110b747fa req-e17c8d52-2b04-47d4-94e2-6560fde80441 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:48.758971 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6896656a-4c96-4180-b15f-b80110b747fa req-e17c8d52-2b04-47d4-94e2-6560fde80441 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:48.778877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-6896656a-4c96-4180-b15f-b80110b747fa req-e17c8d52-2b04-47d4-94e2-6560fde80441 service nova] Creating event network-changed:77bc4dfa-07e0-4c98-90a9-7dc01129cdc5 for instance 1e084f98-237c-4483-b3e7-67e1dda82279 on hv-cinder-74915 Jul 19 20:59:48.797853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-6896656a-4c96-4180-b15f-b80110b747fa req-e17c8d52-2b04-47d4-94e2-6560fde80441 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056185 Jul 19 20:59:48.802499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 312/630] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:49.129608 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:49.131009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:49.147548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.148551 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.150217 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.151189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.171700 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:49.174027 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:49.188955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.191165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.203825 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:49.205071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:49.507856 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:49.517211 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5dbc5d37-3d44-469d-8091-60e64eb2da91 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1315 microversion: 2.1 time: 0.400535 Jul 19 20:59:49.520042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 319/631] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:49 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:49.535874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:49.544888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:49.546501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:49.547682 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f3429a63-c94e-4d1e-95e1-f7994af0de20 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.384390 Jul 19 20:59:49.558267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 313/632] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:49 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:50.533395 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:50.534751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:50.542558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.543355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.544399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.545081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.566361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:50.566960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:50.581729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.582184 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.583183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.583786 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.793205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:50.795945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:50.802902 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c93dc386-057d-4ae1-a34b-905a6e88166e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1465 microversion: 2.1 time: 0.273379 Jul 19 20:59:50.804894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:50.806436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:50.816452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 320/633] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:50 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1465 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:50.820811 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1752affc-f7a3-46f6-b6df-79c0257e81b3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.255722 Jul 19 20:59:50.832467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 314/634] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:50 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:50.857284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:50.857941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:50.865644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.866337 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.867449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:50.868472 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:50.898171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 20:59:50.996650 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-effd7289-2d18-4cf3-841e-1a78699abb37 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "DELETE /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 204 len: 0 microversion: 2.1 time: 0.143840 Jul 19 20:59:51.007056 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:51.007677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:51.010673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 321/635] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 20:59:50 2022] DELETE /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 20:59:51.015596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:51.016374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:51.017338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:51.017822 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:51.172124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:51.186429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9e9eb0d9-d553-4c8c-9e01-e9c896347276 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1471 microversion: 2.1 time: 0.183791 Jul 19 20:59:51.187096 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 315/636] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:51 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:51.840219 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:51.841309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:51.848409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:51.848952 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:51.849810 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:51.850311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.066821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:52.075514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:52.078163 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:52.082969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0db08d9c-8b9d-4241-8e32-e4ac4b0abe1e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.244053 Jul 19 20:59:52.083814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 322/637] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:51 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:52.225391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:52.226162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:52.235496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:52.236233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.237229 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:52.237892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:52.422444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:52.425590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:52.435631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f1dd9cbb-988d-4fbc-8334-d3ae1c2b293e tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1471 microversion: 2.1 time: 0.227499 Jul 19 20:59:52.436227 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 316/638] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:52 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:53.102556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:53.103662 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:53.110485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:53.110941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:53.111759 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:53.112188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:53.250537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:53.272961 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:53.274477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:53.276675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b55c013a-fabd-4ead-b0da-fd295392e753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.178148 Jul 19 20:59:53.277233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 323/639] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:53 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:53.457280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:53.459241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:53.470942 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:53.472129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:53.473180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:53.473790 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:53.805275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:53.817121 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1c2172c9-8195-433b-872f-492af3dfc1bc tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1471 microversion: 2.1 time: 0.366571 Jul 19 20:59:53.819397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 317/640] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:53 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1471 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:54.155633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-5000fb0b-15a3-471f-977a-901f67b268eb req-8d127652-1fdb-4fb3-b8af-c5abd218560a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d6851-aea9-4d75-beba-89e5a32d3c36", "name": "network-vif-deleted", "tag": "7af13dc1-1cd7-4c79-bcf4-3158e79a491f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 20:59:54.173534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5000fb0b-15a3-471f-977a-901f67b268eb req-8d127652-1fdb-4fb3-b8af-c5abd218560a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:54.174089 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5000fb0b-15a3-471f-977a-901f67b268eb req-8d127652-1fdb-4fb3-b8af-c5abd218560a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.187665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-5000fb0b-15a3-471f-977a-901f67b268eb req-8d127652-1fdb-4fb3-b8af-c5abd218560a service nova] Creating event network-vif-deleted:7af13dc1-1cd7-4c79-bcf4-3158e79a491f for instance 993d6851-aea9-4d75-beba-89e5a32d3c36 on hv-cinder-74915 Jul 19 20:59:54.193954 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-5000fb0b-15a3-471f-977a-901f67b268eb req-8d127652-1fdb-4fb3-b8af-c5abd218560a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042155 Jul 19 20:59:54.195199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 324/641] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 20:59:54.296081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:54.297034 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:54.307771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:54.308526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.309488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:54.310874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.473076 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:54.486277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:54.488229 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:54.489519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-308ebdb2-0c98-4906-bb06-75feb681170b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.198170 Jul 19 20:59:54.490095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 318/642] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:54 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 20:59:54.844352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:54.845059 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:54.864461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:54.864921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.865755 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:54.866188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.932948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:54.932948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:54.932948 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lazy-loading 'fault' on Instance uuid 993d6851-aea9-4d75-beba-89e5a32d3c36 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 20:59:55.004273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42ee6d51d5149ba91477623a358e26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc584a9767e74858979d7963227d7ada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:55.015750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c82333f4-3a02-44d5-b9d7-259dcb5cb226 tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 200 len: 1305 microversion: 2.1 time: 0.178165 Jul 19 20:59:55.026731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 325/643] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:54 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 1305 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 20:59:55.510480 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:55.511201 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:55.520119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:55.520664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:55.521506 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:55.522004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:55.680287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:55.692962 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:55.703249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:55.704918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fd065ff9-b5f3-48fd-a4eb-62671f268b08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1739 microversion: 2.20 time: 0.198820 Jul 19 20:59:55.705971 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 319/644] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:55 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:56.034139 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:56.034682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] [instance: 993d6851-aea9-4d75-beba-89e5a32d3c36] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:56.042262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.042699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.043502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.043927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.059178 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] HTTP exception thrown: Instance 993d6851-aea9-4d75-beba-89e5a32d3c36 could not be found. Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Request method failure captured: Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 HTTP/1.1 Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xsls82iIbaSBjkF2tBoOxuXJ8CwtgdH3W5en8Zf3VOVmAhTkNvj3hfgTgpWBVGiiZRur8s9QyR50WdaQ48_iMW7fx5v_Jvnpbf02ftosBMuM79_kg7q_S2BNQqoDtXlh3Yo2Js4S4lAiy2tuqXM_MtwAXkzmgY3lv_h3cNtPetu0WI Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: fc584a9767e74858979d7963227d7ada Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-VolumesNegativeTest-1459777227 Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 20:59:56.060851 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc584a9767e74858979d7963227d7ada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc584a9767e74858979d7963227d7ada"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc584a9767e74858979d7963227d7ada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc584a9767e74858979d7963227d7ada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-VolumesNegativeTest-1459777227 Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: fc584a9767e74858979d7963227d7ada Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-VolumesNegativeTest-1459777227 Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-VolumesNegativeTest-1459777227-project Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: a42ee6d51d5149ba91477623a358e26a Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-VolumesNegativeTest-1459777227-project Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 993d6851-aea9-4d75-beba-89e5a32d3c36 could not be found. Jul 19 20:59:56.062355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '993d6851-aea9-4d75-beba-89e5a32d3c36'} Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993d6851-aea9-4d75-beba-89e5a32d3c36 could not be found. Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 20:59:56.063210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993d6851-aea9-4d75-beba-89e5a32d3c36 could not be found. Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993d6851-aea9-4d75-beba-89e5a32d3c36 could not be found. Jul 19 20:59:56.065270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 20:59:56.067494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] Returning 404 to user: Instance 993d6851-aea9-4d75-beba-89e5a32d3c36 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 20:59:56.067494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ad93b9eb-c660-4c7a-8cb9-f97e44cb075f tempest-VolumesNegativeTest-1459777227 tempest-VolumesNegativeTest-1459777227-project] 10.222.0.85 "GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36" status: 404 len: 111 microversion: 2.1 time: 0.032286 Jul 19 20:59:56.067494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 326/645] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 20:59:56 2022] GET /compute/v2.1/servers/993d6851-aea9-4d75-beba-89e5a32d3c36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:56.723698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:56.724300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:56.730637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.731085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.731854 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:56.732286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:56.887824 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:56.896765 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:56.898257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:56.899485 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-292260b6-a81f-4915-a129-adc6af19a95f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1721 microversion: 2.20 time: 0.179679 Jul 19 20:59:56.900128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 320/646] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:56 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:57.918137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:57.918790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:57.933039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:57.933493 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:57.934272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:57.934726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:57.952024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:58.081190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:58.089535 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:58.091032 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:58.092224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f793afaa-2817-4974-b6b1-5c3732e2ca14 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1721 microversion: 2.20 time: 0.178046 Jul 19 20:59:58.092810 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 327/647] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:57 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 20:59:59.111080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 20:59:59.111691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 20:59:59.118673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:59.119133 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:59.119918 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 20:59:59.120373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 20:59:59.265706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:59.273711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:59.275836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 20:59:59.277119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-972b5915-33be-4362-954b-ee2502ebf278 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1721 microversion: 2.20 time: 0.169972 Jul 19 20:59:59.277998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 321/648] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 20:59:59 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:00.296048 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:00.296864 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:00.303476 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.304063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.305005 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.305540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.439217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-bc53e8df-f89f-47a4-9f14-b19586d102d2 req-01db62a4-35a3-4e53-86cd-7b8d93eaf00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "name": "network-vif-unplugged", "status": "completed", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:00.452252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-bc53e8df-f89f-47a4-9f14-b19586d102d2 req-01db62a4-35a3-4e53-86cd-7b8d93eaf00f service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.452252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-bc53e8df-f89f-47a4-9f14-b19586d102d2 req-01db62a4-35a3-4e53-86cd-7b8d93eaf00f service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.461347 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.compute.server_external_events [req-bc53e8df-f89f-47a4-9f14-b19586d102d2 req-01db62a4-35a3-4e53-86cd-7b8d93eaf00f service nova] Unable to find a host for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05. Dropping event network-vif-unplugged {{(pid=124277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 21:00:00.462802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-bc53e8df-f89f-47a4-9f14-b19586d102d2 req-01db62a4-35a3-4e53-86cd-7b8d93eaf00f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027152 Jul 19 21:00:00.463399 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 322/649] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 21:00:00.500586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:00.515211 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:00.518411 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:00.521157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e65c183e-1167-4cdd-b42f-56d9cbd993f7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1664 microversion: 2.20 time: 0.229123 Jul 19 21:00:00.522075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 328/650] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:00 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:00.543378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a091e419-331a-49e6-80f9-3423f12a8832"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:00.545679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:00.554885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.555409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.556439 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:00.557041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:00.890432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-27ce5091-35a6-4a0b-aed5-817f225e8665 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353797 Jul 19 21:00:00.891049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 323/651] 10.222.0.85 () {62 vars in 1363 bytes} [Tue Jul 19 21:00:00 2022] POST /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments => generated 188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:00:01.015486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:01.015962 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:01.022231 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:01.022668 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:01.023430 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:01.023852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:01.207099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-25d2d9a4-1d63-4840-b6ff-56d349b30aa4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/action" status: 202 len: 0 microversion: 2.20 time: 0.195825 Jul 19 21:00:01.207702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 329/652] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jul 19 21:00:01 2022] POST /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:00:01.216037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:01.216684 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:01.224634 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:01.224634 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:01.225096 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:01.225543 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:01.363563 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:01.372499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:01.373990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:01.375146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-78377ff9-605e-4382-9bf5-b1a20ce3dad9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1750 microversion: 2.20 time: 0.163147 Jul 19 21:00:01.375710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 324/653] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:01 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:00:02.395100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:02.395681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:02.402036 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:02.402457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:02.403237 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:02.403740 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:02.544094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:02.552693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:02.554207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:02.555366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7f709c62-2a17-428e-8901-bd284648f4f8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1752 microversion: 2.20 time: 0.165032 Jul 19 21:00:02.555929 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 330/654] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:02 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:03.574654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:03.575243 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:03.581840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:03.582289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:03.583052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:03.583487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:03.720571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:03.729458 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:03.730957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:03.732119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-01b514a2-4ce3-4309-b646-f3dcaf8654c2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.161969 Jul 19 21:00:03.732702 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 325/655] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:03 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:04.751976 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:04.753190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:04.760815 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:04.761262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:04.762048 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:04.762485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:04.917724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:04.927633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:04.929157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:04.930444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-227bbc97-2768-4d39-b70b-77fe59f5eadb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.184108 Jul 19 21:00:04.931861 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 331/656] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:04 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:05.950461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:05.951772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:05.959818 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:05.960594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:05.961627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:05.962263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:06.103857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:06.112655 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:06.114126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:06.115283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-00c19f0f-bbcb-44d3-a9ff-74bd896cfad4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.169237 Jul 19 21:00:06.115827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 326/657] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:05 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:07.134961 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:07.135801 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:07.142473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:07.142921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:07.143748 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:07.144182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:07.294639 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:07.303066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:07.304586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:07.306401 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-99104502-dff2-4171-b14c-149e64067d3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.175251 Jul 19 21:00:07.307152 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 332/658] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:07 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:08.326274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:08.326877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:08.334470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:08.334849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:08.335621 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:08.336055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:08.498021 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:08.507807 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:08.509890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:08.511065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-831c1f50-3162-4c8b-938c-eb288d3ccf9a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.189916 Jul 19 21:00:08.511619 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 327/659] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:08 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:09.530910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:09.531450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:09.538841 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:09.539281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:09.540055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:09.540569 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:09.673355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:09.681698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:09.683194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:09.684335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f0235530-8569-4d09-800d-41cf332a8474 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.157527 Jul 19 21:00:09.684918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 333/660] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:09 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:00:10.704947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:10.705955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:10.713559 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:10.714317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:10.715118 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:10.715583 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:10.891326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:10.899835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:10.901643 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:10.902827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4181df3a-d31a-4079-88b7-02ccf831c753 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.202035 Jul 19 21:00:10.903584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 328/661] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:10 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:11.921024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:11.921630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:11.928259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:11.928726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:11.929492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:11.929921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:12.119580 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:12.128050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:12.129627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:12.130766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6efed28e-2f19-4fed-9262-cf742c336eea tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.213661 Jul 19 21:00:12.131314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 334/662] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:11 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:13.152247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:13.153884 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:13.161799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:13.162434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:13.163269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:13.163711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:13.329279 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:13.338506 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:13.340054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:13.341187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a133ee4e-a7f1-41fb-8387-fd49c4d0ccfe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.194640 Jul 19 21:00:13.341771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 329/663] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:13 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:14.359518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:14.360164 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:14.362473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:14.367817 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:14.368267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:14.369068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:14.369511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:14.508713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:14.521681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:14.524980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:14.526230 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eec4b2d4-3aad-4325-91d9-70154bc8eae7 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.170563 Jul 19 21:00:14.527145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 335/664] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:14 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:15.546443 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:15.547888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:15.551180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=46 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:15.558401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:15.559374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:15.560434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:15.561331 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:15.735653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:15.744839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:15.746333 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:15.747526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b2af5108-9f9b-4290-a810-83402a8469d3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.205864 Jul 19 21:00:15.748218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 330/665] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:15 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:16.766656 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:16.767312 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:16.773492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:16.774051 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:16.774681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:16.775104 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:16.913741 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:16.923039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:16.924553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:16.925715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-68eb4e32-5652-4017-8449-e98ad870a150 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.163290 Jul 19 21:00:16.926283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 336/666] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:16 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:17.945552 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:17.946222 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:17.953265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:17.953714 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:17.954486 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:17.957269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:17.983275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:18.099414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:18.108810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:18.110321 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:18.111481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dae17a80-1d58-49ba-8f20-a322be64c840 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.169880 Jul 19 21:00:18.112060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 331/667] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:17 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:19.130008 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:19.130794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:19.138110 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:19.138550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:19.139334 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:19.139761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:19.283613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:19.293115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:19.294619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:19.295781 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4caf4476-47ac-4ae6-b83c-2ce0d437dbae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.169741 Jul 19 21:00:19.296398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 337/668] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:19 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:20.315565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:20.316445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:20.325904 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.326356 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.327147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:20.327629 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:20.486310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:20.495353 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:20.496864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:20.498045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8fec1c4d-7b59-4b4d-95b5-69f2bf344d54 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.186670 Jul 19 21:00:20.498591 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 332/669] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:20 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:21.518041 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:21.518751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:21.525392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:21.525830 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:21.526588 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:21.527013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:21.663190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:21.671376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:21.672888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:21.674290 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d850ccf2-7cf5-48dc-82c5-c1856fa49321 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.159980 Jul 19 21:00:21.674602 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 338/670] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:21 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:22.693743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:22.694613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:22.702053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:22.702502 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:22.703294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:22.703730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:22.843004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:22.851703 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:22.853292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:22.854488 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-76bd44f8-95bd-4146-aa23-07bc5d7578c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.165183 Jul 19 21:00:22.855046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 333/671] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:22 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:23.873712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:23.874385 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:23.881194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.881642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:23.882423 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:23.882858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:24.016422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:24.025514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:24.027004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:24.028150 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8acecdf3-aa1b-4e62-a50a-f199293b3a70 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.158375 Jul 19 21:00:24.028741 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 339/672] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:23 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:25.046747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:25.047323 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:25.054530 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:25.055519 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:25.056388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:25.056830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:25.460963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:25.469955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:25.471451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:25.472674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bb3040ee-a081-46ca-aed3-bb9a3e2e465a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.429922 Jul 19 21:00:25.473258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 334/673] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:25 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:26.491437 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:26.492064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:26.499926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:26.500589 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:26.501192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:26.501626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:26.648969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:26.657347 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:26.658908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:26.660081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ff855d89-33c3-4013-8d12-caec4331f09b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.172688 Jul 19 21:00:26.660682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 340/674] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:26 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:27.681487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:27.682202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:27.688463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:27.688956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:27.689722 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:27.690154 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:27.841161 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:27.850119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:27.851567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:27.853407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d8893eb2-e207-44d8-b3f7-34b06abbae46 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.177820 Jul 19 21:00:27.853969 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 335/675] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:27 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:28.872579 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:28.873208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:28.879944 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:28.880449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:28.881273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:28.881707 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:28.885047 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:29.031340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:29.040901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:29.042488 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:29.043693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4eea6ace-268c-40fe-b77b-c809c409a04b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.175159 Jul 19 21:00:29.044260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 341/676] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:28 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:30.066718 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:30.067337 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:30.075480 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:30.076064 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:30.076941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:30.077417 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:30.243049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:30.253773 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:30.255877 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:30.257412 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-23e2d2a2-62b7-4272-b339-39f7029a9022 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.195006 Jul 19 21:00:30.257991 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 336/677] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:30 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:31.280454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:31.281074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:31.288492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:31.288959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:31.289733 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:31.290167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:31.441679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:31.451325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:31.452924 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:31.454044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d2135182-d665-4eb8-97c9-918a48b69d18 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.177854 Jul 19 21:00:31.454605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 342/678] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:31 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:00:32.478741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:32.479833 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:32.490838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:32.491573 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:32.492907 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:32.493632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:32.664980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:32.668255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-1670016c-c3fc-4437-a8a3-15b11ed8a279 req-7b425f2b-3098-48b5-9e0d-6b3e273014ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "name": "network-vif-plugged", "status": "completed", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:00:32.678501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-1670016c-c3fc-4437-a8a3-15b11ed8a279 req-7b425f2b-3098-48b5-9e0d-6b3e273014ac service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:32.679158 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-1670016c-c3fc-4437-a8a3-15b11ed8a279 req-7b425f2b-3098-48b5-9e0d-6b3e273014ac service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:32.683890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:32.691241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:32.691241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-af20ee8f-b05f-4c8f-9200-805d28099ed4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.216131 Jul 19 21:00:32.691241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 337/679] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:32 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:32.697621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-1670016c-c3fc-4437-a8a3-15b11ed8a279 req-7b425f2b-3098-48b5-9e0d-6b3e273014ac service nova] Creating event network-vif-plugged:be0016f3-966e-4341-aec7-fa313f2a1024 for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 on hv-cinder-74915 Jul 19 21:00:32.703193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-1670016c-c3fc-4437-a8a3-15b11ed8a279 req-7b425f2b-3098-48b5-9e0d-6b3e273014ac service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113652 Jul 19 21:00:32.703823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 343/680] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:00:33.706915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:33.707568 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:33.715399 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:33.715853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:33.716730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:33.717177 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:33.856319 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:33.865962 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:33.867946 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:33.869152 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0a6e632a-2d84-4915-87c3-28c32962cac9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.166479 Jul 19 21:00:33.869710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 338/681] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:33 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:34.888735 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:34.889419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:34.895575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:34.896019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:34.896796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:34.897227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:35.034144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:35.042673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:35.044137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:35.045422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e2e2ee95-83ab-4133-987a-37a843c4c0fc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.161504 Jul 19 21:00:35.045969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 344/682] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:34 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:36.063241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:36.063758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:36.070649 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:36.071171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:36.072415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:36.072794 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:36.211170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:36.220291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:36.221810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:36.222989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-708d2675-6882-4263-b35a-140c6364c16d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1808 microversion: 2.20 time: 0.163935 Jul 19 21:00:36.223537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 339/683] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:36 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:00:37.241773 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:00:37.242469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:00:37.249289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:37.249730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:37.250507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:00:37.250941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:00:37.389696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:37.399159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:37.401262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:00:37.402426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d1d73430-b866-4804-878d-a81c8fd1c20a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1795 microversion: 2.20 time: 0.164601 Jul 19 21:00:37.402973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 345/684] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:00:37 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1795 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:01:11.370577 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccbd0f0a-f447-4edc-94d4-52e531dd50a4"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:11.371716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:11.373819 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=19 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:11.374466 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=51 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:11.380754 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:11.381205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:11.382443 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:11.382443 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:11.647855 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7ca934cf-c7b7-42af-9019-bb7f1bbec771 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281533 Jul 19 21:01:11.648484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 340/685] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:01:11 2022] POST /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:19.275181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:19.277003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:19.281349 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=21 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:19.282522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=25 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:19.294398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.295131 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.296620 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.297421 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.351063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lazy-loading 'flavor' on Instance uuid cd76a68e-63b0-4834-8f93-3768570ff8d4 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:19.533767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-33cbb06e-e6a1-42d3-8a3c-308cfaa73c36 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/action" status: 200 len: 32 microversion: 2.1 time: 0.266465 Jul 19 21:01:19.534606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 346/686] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:01:19 2022] POST /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:01:19.548273 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:19.549236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:19.557828 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.558283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.559097 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:19.559613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:19.838453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:19.848167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e2de6f55-02c1-45a0-a27c-dc89f88a6584 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.305775 Jul 19 21:01:19.848815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 341/687] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:19 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:20.877836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:20.878728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:20.890724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:20.891477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:20.892887 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:20.893668 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:21.050902 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:21.060752 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0065162e-3f43-4ea6-bdc8-cf4375fe6a76 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.189102 Jul 19 21:01:21.061682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 347/688] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:20 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:22.079562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:22.080284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:22.088789 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:22.089268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:22.090119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:22.090558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:22.249477 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:22.258433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-252a0858-79e8-4a3f-be5c-c29644b0e0ec tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.182935 Jul 19 21:01:22.259574 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 342/689] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:22 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:23.285326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:23.286186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:23.296068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:23.296753 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:23.297970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:23.298512 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:23.549058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:23.563462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3af655f2-c2c5-4452-ae62-e77659a74ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.282866 Jul 19 21:01:23.564518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 348/690] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:23 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:24.591100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:24.591745 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:24.599020 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:24.599775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:24.600705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:24.601145 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:24.765184 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:24.775168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-241fdeb4-2847-4e37-86c3-d10c56ad4970 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.187918 Jul 19 21:01:24.775805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 343/691] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:24 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:25.794823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:25.796847 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:25.804688 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:25.805115 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:25.806416 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:25.806852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:25.951658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:25.960225 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e53a0156-d1bb-4703-8d3f-83bf57587dcc tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.169261 Jul 19 21:01:25.960877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 349/692] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:25 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:26.985653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:26.986277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:26.993889 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:26.994332 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:26.995123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:26.995556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:27.150452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:27.159461 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2d1f3548-d478-4ead-bbfd-dff8dc093d53 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.177588 Jul 19 21:01:27.160073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 344/693] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:26 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:28.177546 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:28.178245 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:28.185732 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:28.186176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:28.186962 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:28.187390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:28.362528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:28.380316 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4e70f5d8-43a1-4f7c-8760-63d1bb15b231 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.206519 Jul 19 21:01:28.381403 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 350/694] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:28 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:29.415888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:29.417083 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:29.429723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:29.430659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:29.431947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:29.432762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:29.608669 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:29.618410 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-879031a0-11d9-4604-a8ea-cba827583136 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.210487 Jul 19 21:01:29.619022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 345/695] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:29 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:30.647774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:30.648515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:30.656464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:30.656908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:30.657700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:30.658127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:30.826868 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:30.835845 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2e13b2bf-a8ce-429b-8a60-40acd574c11d tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.192264 Jul 19 21:01:30.837044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 351/696] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:30 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:31.866750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:31.867822 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:31.880458 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:31.881307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:31.882687 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:31.883972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:32.046022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:32.054871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6e35d20f-ff91-485e-9023-e8ae8e5a6b8c tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.194997 Jul 19 21:01:32.055459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 346/697] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:31 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:33.082155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:33.082741 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:33.089749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:33.090190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:33.090973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:33.091407 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:33.249414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:33.258348 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-887896a0-fe1c-425e-8164-7b56971ccc83 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1735 microversion: 2.1 time: 0.180049 Jul 19 21:01:33.259466 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 352/698] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:33 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:34.237647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:34.238276 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.245280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.245728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.246513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.246946 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.272924 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f85d8216-41bf-44e9-bf94-320362d3d33b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/ips" status: 200 len: 149 microversion: 2.1 time: 0.039433 Jul 19 21:01:34.273761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 347/699] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 21:01:34 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:34.281475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:34.282301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.285632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a926754d-a275-4f2a-bd44-651d99a6b939"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:34.286822 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.290711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.291273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.292102 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.292566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.293107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.293560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.294338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.294771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.388158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Invalid volume: volume a926754d-a275-4f2a-bd44-651d99a6b939 is already attached to instances: 5aef110a-35e6-4bad-8ec1-279639b358c4 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: POST /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/os-volume_attachments HTTP/1.1 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 74 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:01:34.390326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {"volumeAttachment": {"volumeId": "a926754d-a275-4f2a-bd44-651d99a6b939"}} Jul 19 21:01:34.393131 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Invalid volume: volume a926754d-a275-4f2a-bd44-651d99a6b939 is already attached to instances: 5aef110a-35e6-4bad-8ec1-279639b358c4 Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'server_id': '1e084f98-237c-4483-b3e7-67e1dda82279', 'body': {'volumeAttachment': {'volumeId': 'a926754d-a275-4f2a-bd44-651d99a6b939'}}} Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a926754d-a275-4f2a-bd44-651d99a6b939 is already attached to instances: 5aef110a-35e6-4bad-8ec1-279639b358c4 Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.394779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a926754d-a275-4f2a-bd44-651d99a6b939 is already attached to instances: 5aef110a-35e6-4bad-8ec1-279639b358c4 Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:34.397498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a926754d-a275-4f2a-bd44-651d99a6b939 is already attached to instances: 5aef110a-35e6-4bad-8ec1-279639b358c4 Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 400 to user: Invalid volume: volume a926754d-a275-4f2a-bd44-651d99a6b939 is already attached to instances: 5aef110a-35e6-4bad-8ec1-279639b358c4 {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-33441bde-79e4-4d09-848c-e167981fd26c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110911 Jul 19 21:01:34.400605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 348/700] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:01:34 2022] POST /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 19 21:01:34.406269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:34.406766 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.414378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.414867 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.415685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.416129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.445567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:01:34.510803 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:34.523015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4ebca466-0b3f-4f88-b5ba-6a3f0cde84a4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1715 microversion: 2.1 time: 0.249252 Jul 19 21:01:34.523664 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 353/701] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:34 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1715 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:34.542761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-91dc1feb-8e35-4e7f-a205-2d40d2d7f649 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 204 len: 0 microversion: 2.1 time: 0.140576 Jul 19 21:01:34.543595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 349/702] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:01:34 2022] DELETE /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:01:34.560043 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:34.561193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.569391 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.569990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.571087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.572181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.687649 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:34.689406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.703351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.704304 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.705960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.706832 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.769949 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:34.785168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e9b4faf6-1f33-4deb-bcec-1eedf7648245 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1681 microversion: 2.1 time: 0.234107 Jul 19 21:01:34.786091 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 354/703] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:34 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:34.886711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] HTTP exception thrown: Cannot 'detach_volume' instance cd76a68e-63b0-4834-8f93-3768570ff8d4 while it is in vm_state rescued Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Request method failure captured: Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments/ccbd0f0a-f447-4edc-94d4-52e531dd50a4 HTTP/1.1 Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xqT9co5naxXFhA9K13IQga4rr_hUZX35aVEz2GGVsCoUCqXAjJBjJ2ivspknwRZQcTuQ1wooqOLTAVyzdDxD0xAct4gGNGWkTF5OlxYJzhc6hd3pQiKdDbTyEsPppLByfrxyn_ggwbUs37R21bPUbWmx5QcOloTSTm6AmC8LH8KBo8 Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: d5af714b14ba471980868293588841fd Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:01:34.889767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d5af714b14ba471980868293588841fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d5af714b14ba471980868293588841fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: d5af714b14ba471980868293588841fd Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: ac1b24e50c894dcf8e887275fd91a174 Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:01:34.891711 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Cannot 'detach_volume' instance cd76a68e-63b0-4834-8f93-3768570ff8d4 while it is in vm_state rescued Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'server_id': 'cd76a68e-63b0-4834-8f93-3768570ff8d4', 'id': 'ccbd0f0a-f447-4edc-94d4-52e531dd50a4'} Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:34.892767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cd76a68e-63b0-4834-8f93-3768570ff8d4 while it is in vm_state rescued Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cd76a68e-63b0-4834-8f93-3768570ff8d4 while it is in vm_state rescued Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:01:34.894387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Returning 409 to user: Cannot 'detach_volume' instance cd76a68e-63b0-4834-8f93-3768570ff8d4 while it is in vm_state rescued {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:34.895647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2079ee92-b699-403f-9109-830f857b080e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments/ccbd0f0a-f447-4edc-94d4-52e531dd50a4" status: 409 len: 152 microversion: 2.1 time: 0.212972 Jul 19 21:01:34.895647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 350/704] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:01:34 2022] DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments/ccbd0f0a-f447-4edc-94d4-52e531dd50a4 => generated 152 bytes in 216 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 21:01:34.907014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:34.907945 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:34.918633 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.919396 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:34.920783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:34.921538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:35.019440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-851429fd-993e-49db-98fe-d4cb46f2eb40 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "POST /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/action" status: 202 len: 0 microversion: 2.1 time: 0.119526 Jul 19 21:01:35.020972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 355/705] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:01:34 2022] POST /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:35.033996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:35.035120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:35.049290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:35.050098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:35.051562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:35.052281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:35.242120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:35.252048 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-14c6b378-b9ec-4d76-a4d8-1f737ea8c0e4 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1723 microversion: 2.1 time: 0.225329 Jul 19 21:01:35.252740 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 351/706] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:35 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:35.806067 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:35.806800 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:35.813794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:35.814252 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:35.815031 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:35.815464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:35.989413 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:36.003966 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1dee0c67-6807-4c15-84de-89d09bdba012 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1681 microversion: 2.1 time: 0.202334 Jul 19 21:01:36.005078 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 356/707] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:35 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:36.279806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:36.281841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:36.295202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:36.296260 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:36.297785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:36.298694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:36.502989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:36.512541 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-25296b90-69ab-41c8-997e-1f1501bb68e2 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1723 microversion: 2.1 time: 0.244567 Jul 19 21:01:36.513197 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 352/708] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:36 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:37.024590 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:37.025785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:37.034124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:37.034644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:37.035648 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:37.036083 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:37.259161 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:37.272363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e861b006-77ba-4887-9eaf-ed50394a79f3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1681 microversion: 2.1 time: 0.252306 Jul 19 21:01:37.273315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 357/709] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:37 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:37.540818 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:37.541894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:37.554202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:37.555019 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:37.556491 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:37.557269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:37.791808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:37.798177 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:37.808176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-84c9da5d-cef3-49aa-ab61-204f8f164f28 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1723 microversion: 2.1 time: 0.274980 Jul 19 21:01:37.809261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 353/710] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:37 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:38.146610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-cfea8cd3-8cd5-40e4-929d-27647b51767c req-92c523d6-3c7b-4fcc-b165-0587366fcb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e084f98-237c-4483-b3e7-67e1dda82279", "name": "network-vif-deleted", "tag": "77bc4dfa-07e0-4c98-90a9-7dc01129cdc5"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:38.164172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-cfea8cd3-8cd5-40e4-929d-27647b51767c req-92c523d6-3c7b-4fcc-b165-0587366fcb0a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.165023 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-cfea8cd3-8cd5-40e4-929d-27647b51767c req-92c523d6-3c7b-4fcc-b165-0587366fcb0a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:38.181344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-cfea8cd3-8cd5-40e4-929d-27647b51767c req-92c523d6-3c7b-4fcc-b165-0587366fcb0a service nova] Creating event network-vif-deleted:77bc4dfa-07e0-4c98-90a9-7dc01129cdc5 for instance 1e084f98-237c-4483-b3e7-67e1dda82279 on hv-cinder-74915 Jul 19 21:01:38.187734 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-cfea8cd3-8cd5-40e4-929d-27647b51767c req-92c523d6-3c7b-4fcc-b165-0587366fcb0a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134333 Jul 19 21:01:38.188372 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 358/711] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:01:38.300217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:38.301863 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:38.313170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.313946 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:38.315317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.315972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:38.405230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:38.418372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-afd0383c-3b68-481b-9551-d8a6640cad33 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1614 microversion: 2.1 time: 0.122933 Jul 19 21:01:38.419846 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 354/712] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:38 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1614 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:38.829301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:38.830421 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:38.838924 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.839677 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:38.841175 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:38.841769 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:39.089569 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:39.100763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7e6947c2-dcd1-48a9-81b5-244efe312dc7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1723 microversion: 2.1 time: 0.276841 Jul 19 21:01:39.101516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 359/713] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:38 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:39.442213 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:39.443627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:39.457436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:39.458410 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:39.460378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:39.462490 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:39.522107 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:39.522849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:39.523584 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'fault' on Instance uuid 1e084f98-237c-4483-b3e7-67e1dda82279 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:39.577523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:39.594761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6c99dfcf-487c-4996-a7dc-b1dae7787c61 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 200 len: 1332 microversion: 2.1 time: 0.160140 Jul 19 21:01:39.595351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 355/714] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:39 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:40.127559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:40.128282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:40.136823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.137275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.138088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.138533 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.143844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:40.379201 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:40.395386 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4e489ddf-6675-4058-8a2a-1063635da856 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1729 microversion: 2.1 time: 0.271782 Jul 19 21:01:40.396506 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 360/715] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:40 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:40.419206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:40.420220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:40.433398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.434434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.435870 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.436660 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.556115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4293e75c-d7eb-4923-ba05-8bdae9187257 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143933 Jul 19 21:01:40.557225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 356/716] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 21:01:40 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:40.627079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:40.627989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:40.639781 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.640613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.642052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:40.642819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:40.664193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 HTTP/1.1 Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:01:40.666344 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:01:40.669427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '1e084f98-237c-4483-b3e7-67e1dda82279'} Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:40.670904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:01:40.673571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:40.676567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:40.676567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a625c99d-609b-424a-bf56-c36be9e0ec90 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 404 len: 111 microversion: 2.1 time: 0.048395 Jul 19 21:01:40.676567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 361/717] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:40 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:01:40.686339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9398f9a1-f6d6-4423-b75c-db35b1bbd1d7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '.version_select at 0x7f125f5ad160>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:40.720857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9398f9a1-f6d6-4423-b75c-db35b1bbd1d7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538199776" status: 202 len: 0 microversion: 2.1 time: 0.042390 Jul 19 21:01:40.727542 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 357/718] 10.222.0.85 () {58 vars in 1220 bytes} [Tue Jul 19 21:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538199776 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:41.613312 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:41.614187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:41.621097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.621668 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.622557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.623002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.723157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'services' on Instance uuid 5aef110a-35e6-4bad-8ec1-279639b358c4 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:41.821734 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fd650889-01e7-4fa8-b3fc-454d47760a20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments/a926754d-a275-4f2a-bd44-651d99a6b939" status: 202 len: 0 microversion: 2.1 time: 0.212033 Jul 19 21:01:41.825668 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 362/719] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:01:41 2022] DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments/a926754d-a275-4f2a-bd44-651d99a6b939 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:41.838583 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:41.840846 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:41.844585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:41.857317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.858289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.859507 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.860125 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.920540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-9e2d38ad-0e91-4a16-99e1-2eb92c364e22 req-ff4b4990-0d1f-4aaa-b62f-901de3c8e78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd76a68e-63b0-4834-8f93-3768570ff8d4", "tag": "57db9dc8-d4a7-44fe-8eb7-411c2a063b4d"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:41.930149 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-45a5a1be-57ee-4068-acb5-4df80bcdcf68 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100888 Jul 19 21:01:41.937436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 358/720] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:01:41 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:41.938205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-9e2d38ad-0e91-4a16-99e1-2eb92c364e22 req-ff4b4990-0d1f-4aaa-b62f-901de3c8e78d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:41.939009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-9e2d38ad-0e91-4a16-99e1-2eb92c364e22 req-ff4b4990-0d1f-4aaa-b62f-901de3c8e78d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:41.954265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-9e2d38ad-0e91-4a16-99e1-2eb92c364e22 req-ff4b4990-0d1f-4aaa-b62f-901de3c8e78d service nova] Creating event network-changed:57db9dc8-d4a7-44fe-8eb7-411c2a063b4d for instance cd76a68e-63b0-4834-8f93-3768570ff8d4 on hv-cinder-74915 Jul 19 21:01:41.961030 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-9e2d38ad-0e91-4a16-99e1-2eb92c364e22 req-ff4b4990-0d1f-4aaa-b62f-901de3c8e78d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046370 Jul 19 21:01:41.963035 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 363/721] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:01:42.948994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:42.951682 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:42.973206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:42.973965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:42.974981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:42.975705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.020630 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-25114eaa-8670-4062-9247-fcf69d105690 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078622 Jul 19 21:01:43.020952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 359/722] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:01:42 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:01:43.097550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:43.098117 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:43.105559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.106003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.106809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.107284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.136079 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:01:43.228644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f4f0637e-06b7-4ed5-846c-0e0a71d71cec tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 204 len: 0 microversion: 2.1 time: 0.135850 Jul 19 21:01:43.230024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 364/723] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:01:43 2022] DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:01:43.238676 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:43.239298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:43.246512 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.247744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.247966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.248538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:43.395860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:43.405108 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2781b9c1-98e4-4b4e-a040-d5e638237fd4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1679 microversion: 2.1 time: 0.169860 Jul 19 21:01:43.405512 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 360/724] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:43 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:43.981958 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-dd6a82db-3c2a-4691-902e-731b7c2945d4 req-60151302-4f5e-4af6-a135-b47378878047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd76a68e-63b0-4834-8f93-3768570ff8d4", "tag": "57db9dc8-d4a7-44fe-8eb7-411c2a063b4d"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:43.990815 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-dd6a82db-3c2a-4691-902e-731b7c2945d4 req-60151302-4f5e-4af6-a135-b47378878047 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:43.991262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-dd6a82db-3c2a-4691-902e-731b7c2945d4 req-60151302-4f5e-4af6-a135-b47378878047 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.004869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-dd6a82db-3c2a-4691-902e-731b7c2945d4 req-60151302-4f5e-4af6-a135-b47378878047 service nova] Creating event network-changed:57db9dc8-d4a7-44fe-8eb7-411c2a063b4d for instance cd76a68e-63b0-4834-8f93-3768570ff8d4 on hv-cinder-74915 Jul 19 21:01:44.010322 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-dd6a82db-3c2a-4691-902e-731b7c2945d4 req-60151302-4f5e-4af6-a135-b47378878047 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032945 Jul 19 21:01:44.010937 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 365/725] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:44.426433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:44.427548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:44.432695 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:44.433540 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:44.442852 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.447335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.447792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.448612 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.449053 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.452471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.453315 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.453756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.509340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d91a02d5-3b09-45bd-b008-bb619e32cbc2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments/a091e419-331a-49e6-80f9-3423f12a8832" status: 200 len: 194 microversion: 2.20 time: 0.088341 Jul 19 21:01:44.510303 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 366/726] 10.222.0.85 () {60 vars in 1453 bytes} [Tue Jul 19 21:01:44 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments/a091e419-331a-49e6-80f9-3423f12a8832 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:01:44.655998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:44.657267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:44.674703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.675935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.677790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:44.678870 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:44.818202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:44.818522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lazy-loading 'services' on Instance uuid 318211d6-3f74-4f53-bfd8-0a10d7272b05 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:44.834552 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f72878e-114e-4a51-a430-3ad9424a9e72 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1679 microversion: 2.1 time: 0.415202 Jul 19 21:01:44.842077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 361/727] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:44 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1679 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:44.972886 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9c464d96-a65b-406b-9c78-46003270094d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments/a091e419-331a-49e6-80f9-3423f12a8832" status: 202 len: 0 microversion: 2.20 time: 0.324452 Jul 19 21:01:44.973890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 367/728] 10.222.0.85 () {60 vars in 1456 bytes} [Tue Jul 19 21:01:44 2022] DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments/a091e419-331a-49e6-80f9-3423f12a8832 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:01:44.989663 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:44.992178 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:45.006298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.007451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.009910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.011003 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.077785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-58e725b1-14c5-4d3e-a7c9-bdbb9d96b316 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095732 Jul 19 21:01:45.084712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 362/729] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jul 19 21:01:44 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:01:45.861891 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:45.863400 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:45.873885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.874523 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.875402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:45.876064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:45.976858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:45.987248 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-76240e62-73dc-48ef-b142-7dc4c987d9fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1612 microversion: 2.1 time: 0.132200 Jul 19 21:01:45.988287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 368/730] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:45 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1612 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:46.094748 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:46.096168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:46.110086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.110932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.113638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.114337 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.148623 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e0847717-ceb8-436d-9700-a7c7e5d017d0 req-7373bf3b-d56e-40df-9416-d333bd141a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aef110a-35e6-4bad-8ec1-279639b358c4", "name": "network-vif-deleted", "tag": "e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:46.158381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a17dbe18-b875-4cc0-b436-4459a2a3f8c1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068738 Jul 19 21:01:46.159394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e0847717-ceb8-436d-9700-a7c7e5d017d0 req-7373bf3b-d56e-40df-9416-d333bd141a25 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.160102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e0847717-ceb8-436d-9700-a7c7e5d017d0 req-7373bf3b-d56e-40df-9416-d333bd141a25 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.164273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 369/731] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jul 19 21:01:46 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:46.173983 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e0847717-ceb8-436d-9700-a7c7e5d017d0 req-7373bf3b-d56e-40df-9416-d333bd141a25 service nova] Creating event network-vif-deleted:e6c291e3-6e5c-44cf-a2ae-82d896ecc1cb for instance 5aef110a-35e6-4bad-8ec1-279639b358c4 on hv-cinder-74915 Jul 19 21:01:46.179746 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e0847717-ceb8-436d-9700-a7c7e5d017d0 req-7373bf3b-d56e-40df-9416-d333bd141a25 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142403 Jul 19 21:01:46.181000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 363/732] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:46.240563 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:46.241132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:46.247898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.248535 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.249366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.249807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.282735 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:01:46.395188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-774eaa7a-02c3-4100-8f67-c5c031cadc71 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 204 len: 0 microversion: 2.20 time: 0.158648 Jul 19 21:01:46.396224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 370/733] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jul 19 21:01:46 2022] DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 21:01:46.411842 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:46.413636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:46.426393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.427566 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.429032 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:46.429823 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:46.642027 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:46.651389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:46.653148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:46.654409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6151cea9-be04-458c-9e6a-37a11d1f60a1 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.251251 Jul 19 21:01:46.654977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 364/734] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:46 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:01:47.008575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:47.009516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:47.016941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.017497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.018372 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.018818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.059208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.060013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.062166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'fault' on Instance uuid 5aef110a-35e6-4bad-8ec1-279639b358c4 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:47.120085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:47.131875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c309bf70-8388-413f-a2d2-e501ce3a51f9 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 200 len: 1331 microversion: 2.1 time: 0.129538 Jul 19 21:01:47.132486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 371/735] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:47 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:47.684298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:47.685089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:47.692258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.692738 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.693546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:47.693987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:47.874814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:47.890239 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:47.893441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:47.895080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7ff168c2-d225-4d3c-8d4e-2358edd77acf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.215317 Jul 19 21:01:47.896004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 365/736] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:47 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:01:48.157712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:48.158903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:48.170365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.171102 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:48.172297 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.173007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 HTTP/1.1 Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:01:48.205754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:01:48.208901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '5aef110a-35e6-4bad-8ec1-279639b358c4'} Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:48.210616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:01:48.213325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:48.216796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:48.216796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a3527e8d-f6b5-4686-a76d-7c076dab04c7 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 404 len: 111 microversion: 2.1 time: 0.057873 Jul 19 21:01:48.216796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 372/737] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:48 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:01:48.221816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1c24ab60-d08a-416c-a023-216b4e36cfb6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '.version_select at 0x7f125f5af430>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:48.243325 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1c24ab60-d08a-416c-a023-216b4e36cfb6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553711808" status: 202 len: 0 microversion: 2.1 time: 0.026742 Jul 19 21:01:48.243926 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 366/738] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jul 19 21:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553711808 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:01:48.917854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:48.918389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:48.927946 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.928722 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:48.930556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:48.931231 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:49.326609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:49.337946 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:49.339794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:49.341351 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c1b16c26-c05c-45df-b335-7084087397bf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1723 microversion: 2.20 time: 0.428601 Jul 19 21:01:49.342335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 373/739] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:48 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:01:49.495779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f487e24b-8a6e-4087-b25d-3c89922731fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: .version_select at 0x7f125f553040>, body: {"keypair": {"name": "tempest-keypair-568703511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFb/gAOV3l78JNS37fD7PZTCszNV1lxWi9FV3f0j/u9qNvhIRaOZkRj8xmTc4/zDKU4v43iQx9OAX/t9tKAv1z5FEipL2MMP1fZ3SCLPoeFoifk9s9wlkmanuPxEy2r8kw=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:49.522045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-f487e24b-8a6e-4087-b25d-3c89922731fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:49.530424 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-f487e24b-8a6e-4087-b25d-3c89922731fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:49.571785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f487e24b-8a6e-4087-b25d-3c89922731fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084500 Jul 19 21:01:49.580967 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 367/740] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 21:01:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:50.254426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-fec54946-0bf7-4669-a131-382a0065b8e0 req-73aeb2d8-c69d-4b6e-9ff0-541632b6f349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "318211d6-3f74-4f53-bfd8-0a10d7272b05", "name": "network-vif-deleted", "tag": "be0016f3-966e-4341-aec7-fa313f2a1024"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:50.275419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:50.288260 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-fec54946-0bf7-4669-a131-382a0065b8e0 req-73aeb2d8-c69d-4b6e-9ff0-541632b6f349 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:50.289515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-fec54946-0bf7-4669-a131-382a0065b8e0 req-73aeb2d8-c69d-4b6e-9ff0-541632b6f349 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:50.327389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-fec54946-0bf7-4669-a131-382a0065b8e0 req-73aeb2d8-c69d-4b6e-9ff0-541632b6f349 service nova] Creating event network-vif-deleted:be0016f3-966e-4341-aec7-fa313f2a1024 for instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 on hv-cinder-74915 Jul 19 21:01:50.351428 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-fec54946-0bf7-4669-a131-382a0065b8e0 req-73aeb2d8-c69d-4b6e-9ff0-541632b6f349 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120568 Jul 19 21:01:50.352234 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 374/741] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:50.367916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:50.372983 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:50.403180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:50.403981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:50.405371 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:50.406409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:50.487128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:50.488021 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:50.489250 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lazy-loading 'fault' on Instance uuid 318211d6-3f74-4f53-bfd8-0a10d7272b05 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:01:50.565934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:50.583935 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:50.587257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:50.590032 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f3309172-b67b-4cb9-bff4-9eecc0dea213 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 200 len: 1371 microversion: 2.20 time: 0.230052 Jul 19 21:01:50.591110 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 368/742] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:50 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:01:51.624858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:51.626336 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:51.638967 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:51.640075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:51.641809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:51.642742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:51.652853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:51.677370 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] HTTP exception thrown: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Request method failure captured: Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 HTTP/1.1 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoNpZwlRBZK-yaWeKAGNAWgJ8QEKard1NQYBwKqfhM5THiiPSEtjvPnMOggrfA35Rm_oWoDzsd6I0Y9_OhhD4nGtPkEJ7uyrbSrptwQKDkLZ0aFkaAu8rWPzvQBJeXvN_d6UZWBdjY72nhKeVCfz6BKnrwwGjrSiEowPAP5Jbfu--A Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:01:51.681147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 1f026e791bf24a9fab1aaedb794e6229 Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:01:51.684125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '318211d6-3f74-4f53-bfd8-0a10d7272b05'} Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:01:51.686326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:01:51.688980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:01:51.694326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Returning 404 to user: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:01:51.694326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e1e02bd5-049d-42c7-ae72-67718e6ea718 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 404 len: 111 microversion: 2.20 time: 0.074619 Jul 19 21:01:51.694326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 375/743] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:51 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:01:51.707831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-73cbf7ef-44b2-49d9-bd73-65d3ccae7567 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '.version_select at 0x7f125f5ad430>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:51.740101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-73cbf7ef-44b2-49d9-bd73-65d3ccae7567 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-848711117" status: 204 len: 0 microversion: 2.20 time: 0.040210 Jul 19 21:01:51.745909 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 369/744] 10.222.0.85 () {60 vars in 1258 bytes} [Tue Jul 19 21:01:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-848711117 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 21:01:51.783672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1048168126", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96395a07-97fe-40fb-bf6f-dcb0f6511ee1"}], "security_groups": [{"name": "tempest-securitygroup--1714448544"}], "key_name": "tempest-keypair-568703511", "user_data": "}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:51.944192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] validate_networks() for [('96395a07-97fe-40fb-bf6f-dcb0f6511ee1', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:01:52.427322 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:01:52.427947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:01:52.428448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:01:52.428868 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:01:52.429276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:01:52.440311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:52.441080 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:52.442860 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:52.443675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:52.472881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:52.478309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:52.493145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:01:52.495538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:01:52.562923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0c74bbc4-c225-44f5-b7b9-0824fe2b52ce tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.789445 Jul 19 21:01:52.564185 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 376/745] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:01:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:01:52.577698 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e8b2716b-80ab-4969-b510-deb8cf665175 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:52.578910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e8b2716b-80ab-4969-b510-deb8cf665175 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:52.664055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-762c17b7-4c0c-4161-82b6-38e4814954a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'create', calling method: .version_select at 0x7f125f540820>, body: {"keypair": {"name": "tempest-keypair-1342986633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTyUrb5HZG4YfgJS5uMuHlyWqbhRlFTdNWoyZ0fcO2ySduSqcRZ6iHAXE2OhCTIriaWJYozQoAKG23WjdVlA0CP06i4ljYNS4wKBQc+/BvTlIctUzjsyWjqrs2cQYkBNA=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:52.664976 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e8b2716b-80ab-4969-b510-deb8cf665175 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:52.674430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e8b2716b-80ab-4969-b510-deb8cf665175 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1241 microversion: 2.1 time: 0.101957 Jul 19 21:01:52.675852 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 370/746] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:52 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:52.687758 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-762c17b7-4c0c-4161-82b6-38e4814954a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:52.692886 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-762c17b7-4c0c-4161-82b6-38e4814954a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for user 1f026e791bf24a9fab1aaedb794e6229 and project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:52.719690 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-762c17b7-4c0c-4161-82b6-38e4814954a9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.063736 Jul 19 21:01:52.720318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 377/747] 10.222.0.85 () {62 vars in 1199 bytes} [Tue Jul 19 21:01:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 21:01:53.702027 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:53.703539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:53.715230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:53.715844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:53.717249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:53.717929 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:53.818140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:53.832236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3e323913-faaf-46a5-9b74-37db4959d158 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1293 microversion: 2.1 time: 0.134213 Jul 19 21:01:53.833417 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 371/748] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:53 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:54.861671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:54.862537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:54.874509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:54.875284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:54.877098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:54.877884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:55.011610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:55.026509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c71190df-7933-45d0-ad00-5518f4d57e20 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1299 microversion: 2.1 time: 0.171341 Jul 19 21:01:55.027663 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 378/749] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:54 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:55.241793 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-582590719", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94f06112-ed58-4b53-af27-58837f61b880"}], "security_groups": [{"name": "tempest-securitygroup--541486082"}], "key_name": "tempest-keypair-1342986633", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:55.442135 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] validate_networks() for [('94f06112-ed58-4b53-af27-58837f61b880', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:01:56.048034 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:56.049291 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:56.057443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:56.058038 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:56.059309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:56.059965 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:56.549598 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:56.559142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-26797757-9b5c-44e9-8567-7fbfadd7b4a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.515073 Jul 19 21:01:56.560046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 379/750] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:56 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:01:56.711665 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:01:56.713534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:01:56.715847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:01:56.716399 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:01:56.717405 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:01:56.748085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:56.748963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:56.750871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:56.751646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:56.786556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:01:56.794919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Getting quotas for user 1f026e791bf24a9fab1aaedb794e6229 and project c9432177a8ce4a4abec0ac6e372ce681. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:01:56.818626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:01:56.823348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:01:56.900000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8a0f603a-9730-4c2a-9088-4517ba212810 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.666613 Jul 19 21:01:56.901057 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 372/751] 10.222.0.85 () {62 vars in 1187 bytes} [Tue Jul 19 21:01:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 19 21:01:56.919040 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1a143f6a-c50b-4ccd-968a-ffe99f757a3b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:56.920686 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1a143f6a-c50b-4ccd-968a-ffe99f757a3b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:57.043956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1a143f6a-c50b-4ccd-968a-ffe99f757a3b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:57.065750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1a143f6a-c50b-4ccd-968a-ffe99f757a3b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:57.069723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1a143f6a-c50b-4ccd-968a-ffe99f757a3b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:57.072842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1a143f6a-c50b-4ccd-968a-ffe99f757a3b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1281 microversion: 2.20 time: 0.162046 Jul 19 21:01:57.091028 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 380/752] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:56 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:01:57.121457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-b204c152-e73d-4907-92fd-537fbaee5683 req-efc6d4b9-6fc7-4077-bd2a-6720cf14e080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcd3d43-1700-4062-b83f-6a1851ae44bd", "tag": "3f062646-e05e-457c-b3f6-6fc038438287"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:01:57.139803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-b204c152-e73d-4907-92fd-537fbaee5683 req-efc6d4b9-6fc7-4077-bd2a-6720cf14e080 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:57.140883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-b204c152-e73d-4907-92fd-537fbaee5683 req-efc6d4b9-6fc7-4077-bd2a-6720cf14e080 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:57.162338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-b204c152-e73d-4907-92fd-537fbaee5683 req-efc6d4b9-6fc7-4077-bd2a-6720cf14e080 service nova] Creating event network-changed:3f062646-e05e-457c-b3f6-6fc038438287 for instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd on hv-cinder-74915 Jul 19 21:01:57.171556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-b204c152-e73d-4907-92fd-537fbaee5683 req-efc6d4b9-6fc7-4077-bd2a-6720cf14e080 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057480 Jul 19 21:01:57.173037 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 373/753] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:01:57.584889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:57.586898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:57.600812 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:57.602116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:57.603566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:57.604373 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:57.877030 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:57.887712 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-94093bcf-9df9-45ba-a851-ba74b7055f15 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.311569 Jul 19 21:01:57.889408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 381/754] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:57 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:58.105453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:58.106070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:58.113140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:58.113594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:58.114403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:58.114843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:58.185949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:58.196003 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:58.197950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:58.199287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-99d99fa2-442a-409b-8881-a5269630ad4c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1333 microversion: 2.20 time: 0.099492 Jul 19 21:01:58.199932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 374/755] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:58 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1333 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:01:58.907359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:58.907961 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:58.914724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:58.915164 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:58.915936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:58.916395 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:59.058836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:59.067253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6eb26e0f-0c99-41c2-b407-ba7a9848f8e4 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.163431 Jul 19 21:01:59.067973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 382/756] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:01:58 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:01:59.222392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:01:59.223149 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:01:59.231026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:59.231468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:59.232314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:01:59.232782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:01:59.306667 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:59.315748 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:59.317876 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:01:59.319150 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c8599327-bf13-4aff-9052-427a4154b323 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1333 microversion: 2.20 time: 0.103364 Jul 19 21:01:59.319785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 375/757] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:01:59 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:02:00.086465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:00.087338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:00.094461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:00.094913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:00.095695 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:00.096128 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:00.271499 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:00.282562 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2c98ddab-d19a-4024-845c-558bad936406 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.200538 Jul 19 21:02:00.283171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 383/758] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:00 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:00.338299 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:00.338905 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:00.345647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:00.346082 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:00.346860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:00.347289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:00.418673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:00.436033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:00.437688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:00.439267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1b90d59e-af7d-4a2a-bd2d-18448f56df01 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1333 microversion: 2.20 time: 0.104746 Jul 19 21:02:00.440708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 376/759] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:00 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:02:01.313700 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:01.316177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:01.328666 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.329720 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.332012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.332998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.463694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:01.465016 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:01.477496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.479371 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.480763 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:01.481527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:01.520315 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=100 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:01.601514 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:01.603393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:01.612293 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d41cff0e-7d32-48be-8f81-c53192e72629 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.312384 Jul 19 21:02:01.619707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:01.622865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 384/760] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:01 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:01.623325 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:01.625192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-22d769bd-3dde-433a-9d9a-bcd619f9faa5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1339 microversion: 2.20 time: 0.169195 Jul 19 21:02:01.626332 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 377/761] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:01 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:02:02.636918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:02.651323 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:02.667742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:02.668073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:02.669141 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:02.674931 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.677209 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.680094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.681277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.682853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.683978 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.685827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:02.686849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:02.998896 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:03.012449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d857b36a-2090-44c2-a6af-7333a7e74cbd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.382375 Jul 19 21:02:03.014402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 385/762] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:02 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:03.030925 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-e4fc6a7e-2f1b-4066-9c59-47f6b4cd560c req-d86b0a93-7e0c-4610-ac63-13ae83fed180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:03.045172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e4fc6a7e-2f1b-4066-9c59-47f6b4cd560c req-d86b0a93-7e0c-4610-ac63-13ae83fed180 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:03.045910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-e4fc6a7e-2f1b-4066-9c59-47f6b4cd560c req-d86b0a93-7e0c-4610-ac63-13ae83fed180 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:03.076390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-e4fc6a7e-2f1b-4066-9c59-47f6b4cd560c req-d86b0a93-7e0c-4610-ac63-13ae83fed180 service nova] Creating event network-changed:f425b1ee-f44a-45dc-b4ef-247a915d2a5f for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 on hv-cinder-74915 Jul 19 21:02:03.082990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-e4fc6a7e-2f1b-4066-9c59-47f6b4cd560c req-d86b0a93-7e0c-4610-ac63-13ae83fed180 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066651 Jul 19 21:02:03.083941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 386/763] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:03.117911 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:03.137093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:03.145565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:03.147035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-700eb105-96d2-4c80-ac4e-0438673c0853 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.497735 Jul 19 21:02:03.147814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 378/764] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:02 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:02:03.329705 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-02cb1ff8-34e1-4173-9cb3-253a25f8b939 req-37df9983-3300-45e4-a637-c76309139e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcd3d43-1700-4062-b83f-6a1851ae44bd", "name": "network-vif-plugged", "status": "completed", "tag": "3f062646-e05e-457c-b3f6-6fc038438287"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:03.344849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-02cb1ff8-34e1-4173-9cb3-253a25f8b939 req-37df9983-3300-45e4-a637-c76309139e39 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:03.345599 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-02cb1ff8-34e1-4173-9cb3-253a25f8b939 req-37df9983-3300-45e4-a637-c76309139e39 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:03.367431 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-02cb1ff8-34e1-4173-9cb3-253a25f8b939 req-37df9983-3300-45e4-a637-c76309139e39 service nova] Creating event network-vif-plugged:3f062646-e05e-457c-b3f6-6fc038438287 for instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd on hv-cinder-74915 Jul 19 21:02:03.377585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-02cb1ff8-34e1-4173-9cb3-253a25f8b939 req-37df9983-3300-45e4-a637-c76309139e39 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053093 Jul 19 21:02:03.379109 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 387/765] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:04.042949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:04.043671 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:04.051764 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:04.052231 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.053062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:04.053501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.180604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:04.181545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:04.189266 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:04.189715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.190513 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:04.190955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:04.220419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:04.230118 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-05efdb8f-299e-4ffd-bb6d-803ee57eb9bc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.191298 Jul 19 21:02:04.231101 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 379/766] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:04 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:04.370994 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:04.379854 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:04.381419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:04.383160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c7a4509f-adc9-46c3-a1d7-d760526943c3 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.207825 Jul 19 21:02:04.383744 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 388/767] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:04 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:02:05.250217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:05.251111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:05.258394 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.259307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.259857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.260355 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.402455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:05.403257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:05.413172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.413727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.414728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:05.415323 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:05.418393 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.431434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-57290f69-7dc6-40e7-ac45-8bf74f556551 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.185674 Jul 19 21:02:05.432068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 380/768] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:05 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:05.587462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.597601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.599196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:05.600542 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2bf68f74-8d1d-4a5b-9888-e58926034ca2 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.202816 Jul 19 21:02:05.601233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 389/769] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:05 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:02:06.452152 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:06.452968 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:06.460516 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:06.461431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.462351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:06.462835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.619186 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:06.622204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:06.623013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:06.629007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e5fc6b8b-69d5-427b-ab3e-f12381ecc428 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.181066 Jul 19 21:02:06.629928 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 381/770] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:06 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:06.631326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:06.631890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.632913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:06.633456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:06.793509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:06.809275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:06.812521 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:06.814424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1666c0bc-4de4-4d44-acb1-29a21182a980 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.197100 Jul 19 21:02:06.815679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 390/771] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:06 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:02:07.113589 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:07.114156 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:07.116126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:07.118273 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=12 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:07.125436 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.126117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.126949 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.127384 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.156163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:02:07.255562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a568710f-0ef1-46fb-9caf-96e2d7aa7bb7 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "DELETE /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 204 len: 0 microversion: 2.1 time: 0.145535 Jul 19 21:02:07.256645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 382/772] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:02:07 2022] DELETE /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:02:07.265880 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:07.266539 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:07.268795 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=12 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:07.274875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.275320 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.276111 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.276605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.423971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:07.431974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-334b7321-36d7-41c2-9f34-6ebf44bbaa75 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1574 microversion: 2.1 time: 0.170110 Jul 19 21:02:07.432614 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 391/773] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:07 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:07.651568 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:07.652786 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:07.660991 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.661587 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.662548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.663111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.811328 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:07.819692 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4e2e79f7-3d85-4809-8a44-2dd97a308e55 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1367 microversion: 2.1 time: 0.173712 Jul 19 21:02:07.820401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 383/774] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:07 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:07.837127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:07.837127 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:07.843295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.843740 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.844584 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:07.845247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:07.997622 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:08.006791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:08.008953 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:08.010291 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e4a4cab3-bd16-46e1-803a-353ed39286fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.179600 Jul 19 21:02:08.010861 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 392/775] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:07 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:02:08.453212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:08.454168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:08.463142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:08.463596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:08.464437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:08.464886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:08.659228 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:08.667958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-18f75d42-39d4-4c4b-acf4-629a6c61ea11 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1574 microversion: 2.1 time: 0.220712 Jul 19 21:02:08.668853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 384/776] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:08 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:08.838957 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:08.840063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:08.851075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:08.852017 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:08.853969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:08.854790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.010622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-8f756388-c6d3-4128-a403-7193cc058b42 req-322a1bb1-486d-41b0-be30-50b796883def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "name": "network-vif-plugged", "status": "completed", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:09.022088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:09.025829 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-8f756388-c6d3-4128-a403-7193cc058b42 req-322a1bb1-486d-41b0-be30-50b796883def service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.026675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-8f756388-c6d3-4128-a403-7193cc058b42 req-322a1bb1-486d-41b0-be30-50b796883def service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.035332 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-32b75f55-d4de-4a22-8cfe-18cec1d631db tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1556 microversion: 2.1 time: 0.201263 Jul 19 21:02:09.052486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 393/777] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:08 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1556 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:09.052486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:09.052486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:09.058804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.059444 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.060770 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.060963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-8f756388-c6d3-4128-a403-7193cc058b42 req-322a1bb1-486d-41b0-be30-50b796883def service nova] Creating event network-vif-plugged:f425b1ee-f44a-45dc-b4ef-247a915d2a5f for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 on hv-cinder-74915 Jul 19 21:02:09.062382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.071142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-8f756388-c6d3-4128-a403-7193cc058b42 req-322a1bb1-486d-41b0-be30-50b796883def service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065800 Jul 19 21:02:09.072225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 385/778] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:09.081707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:09.082651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:09.095111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.095859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.099593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.100377 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.255450 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5040b5aa-af92-4f99-bf47-bd62e28245f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181540 Jul 19 21:02:09.256157 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 386/779] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 21:02:09 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:09.323220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:09.333911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:09.337222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:09.338592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-40e571c5-ba6c-4d03-a46b-04d4dd9f0803 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.300712 Jul 19 21:02:09.339298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 394/780] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:09 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:02:09.696590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:09.699372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:09.711700 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.712679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:09.714263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:09.715431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:10.049662 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:10.059369 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6679d76f-bdea-4c7e-9ad7-d862715623b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1574 microversion: 2.1 time: 0.371905 Jul 19 21:02:10.060142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 387/781] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:09 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1574 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:10.359515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:10.360375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:10.367957 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:10.368815 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:10.369736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:10.370254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:10.575703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:10.585365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:10.588078 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:10.589569 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8f1ea43c-7f6e-4f5d-9654-e45c16207f34 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1406 microversion: 2.20 time: 0.235055 Jul 19 21:02:10.590403 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 395/782] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:10 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:02:11.079957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:11.080688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:11.083557 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:11.090080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.090671 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.091548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.092850 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.184768 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:11.206807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-1606eabc-9baa-40c6-83ea-f544cc1c7766 req-a628f64b-c9f4-4416-beba-7d966e9c654a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcd3d43-1700-4062-b83f-6a1851ae44bd", "tag": "3f062646-e05e-457c-b3f6-6fc038438287"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:11.215396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a96085c1-d29f-4b6d-8f05-49962e2c3254 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1506 microversion: 2.1 time: 0.130519 Jul 19 21:02:11.233521 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-1606eabc-9baa-40c6-83ea-f544cc1c7766 req-a628f64b-c9f4-4416-beba-7d966e9c654a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.233521 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-1606eabc-9baa-40c6-83ea-f544cc1c7766 req-a628f64b-c9f4-4416-beba-7d966e9c654a service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.235414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 388/783] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:11 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:11.257528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-1606eabc-9baa-40c6-83ea-f544cc1c7766 req-a628f64b-c9f4-4416-beba-7d966e9c654a service nova] Creating event network-changed:3f062646-e05e-457c-b3f6-6fc038438287 for instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd on hv-cinder-74915 Jul 19 21:02:11.268073 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-1606eabc-9baa-40c6-83ea-f544cc1c7766 req-a628f64b-c9f4-4416-beba-7d966e9c654a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070373 Jul 19 21:02:11.269245 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 396/784] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:02:11.610481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:11.611103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:11.618157 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.618751 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.620445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.620946 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.832956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:11.846594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:11.848198 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:11.850741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f4861369-2903-4b02-b3f3-e591f7a7001f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1597 microversion: 2.20 time: 0.243870 Jul 19 21:02:11.850741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 389/785] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:02:11 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1597 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:02:11.884765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:11.887895 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:11.902868 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.903766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.905379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:11.906234 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:11.914780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:12.029706 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fa324ef7-1f10-41cc-a396-3702fa50ad4b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.152792 Jul 19 21:02:12.040468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 397/786] 10.222.0.85 () {60 vars in 1315 bytes} [Tue Jul 19 21:02:11 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:02:12.259574 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:12.265959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:12.291145 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:12.291868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:12.293272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:12.294249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:12.445679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:12.470303 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-de74dc6b-c6eb-4735-9ff5-0bfb900115ea tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 200 len: 1224 microversion: 2.1 time: 0.225110 Jul 19 21:02:12.496879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 390/787] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:12 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 1224 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:13.306012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-5abbffd4-dc2d-42f4-8474-d1cb343c68ec req-66d55be1-3b97-4221-a3ab-8dd29308cfaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13be579c-9ae8-4e74-9d8f-5dd6d6202c42", "name": "network-vif-deleted", "tag": "24a941e2-60b0-493d-a0ce-2834b56f93e1"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:13.317261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5abbffd4-dc2d-42f4-8474-d1cb343c68ec req-66d55be1-3b97-4221-a3ab-8dd29308cfaf service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:13.318025 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5abbffd4-dc2d-42f4-8474-d1cb343c68ec req-66d55be1-3b97-4221-a3ab-8dd29308cfaf service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:13.335664 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-5abbffd4-dc2d-42f4-8474-d1cb343c68ec req-66d55be1-3b97-4221-a3ab-8dd29308cfaf service nova] Creating event network-vif-deleted:24a941e2-60b0-493d-a0ce-2834b56f93e1 for instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 on hv-cinder-74915 Jul 19 21:02:13.345235 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-5abbffd4-dc2d-42f4-8474-d1cb343c68ec req-66d55be1-3b97-4221-a3ab-8dd29308cfaf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042704 Jul 19 21:02:13.346318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 398/788] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:13.509939 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:13.510730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:13.519599 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:13.520119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:13.521046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:13.521491 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:13.540126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] HTTP exception thrown: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Request method failure captured: Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 HTTP/1.1 Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xrf9Veh_GHQOKZ0qT0n1EXsqe3nJCL9yEvO1VKrFmwzFJM3_F13Haa2TAGf4WVoooEMAgOt5wJj6H5ag9pcL6H-oTHmxnGn8VnQQZ9ekDCNCLrmzR6Nc0zLUgAYDaWaaPlO_PHPNPBIB2Lw1OhWXvHnC89XZuvE5jO4etw__TbiJPM Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:02:13.542459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08c8f78187d474a865ea712616685cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08c8f78187d474a865ea712616685cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 5634da4012cc4d468f84409736c28e09 Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:02:13.546170 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '13be579c-9ae8-4e74-9d8f-5dd6d6202c42'} Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:02:13.547780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:02:13.550143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:02:13.552220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Returning 404 to user: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:02:13.552220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e7a080cb-4a89-4062-b513-de939427c741 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 404 len: 111 microversion: 2.1 time: 0.039239 Jul 19 21:02:13.552220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 391/789] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:13 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:02:13.760249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1072329148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897274336", "security_groups": [{"name": "tempest-secgroup-smoke-1746131802"}], "block_device_mapping_v2": [{"uuid": "ef1c8849-e519-404b-8896-cf2114f91a46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2a1cb6e-5ef1-4fb9-b7b1-7ad9aeec34c4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:13.915557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] validate_networks() for [('f2a1cb6e-5ef1-4fb9-b7b1-7ad9aeec34c4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:02:14.720277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:02:14.722279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:02:14.723323 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:02:14.724647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:02:14.725468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:02:14.737832 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:14.738280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:14.739090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:14.739524 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:14.759950 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for project e08c8f78187d474a865ea712616685cc. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:02:14.766763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for user 5634da4012cc4d468f84409736c28e09 and project e08c8f78187d474a865ea712616685cc. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:02:14.837404 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:02:14.840426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef1c8849-e519-404b-8896-cf2114f91a46',volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:02:15.013539 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b9ab391a-33ea-4d5c-b6c5-2f431a27cdf1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.259034 Jul 19 21:02:15.014881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 399/790] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:02:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:02:15.030897 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d2280e5c-805d-4223-a367-c0d8ce8af79e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:15.031514 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d2280e5c-805d-4223-a367-c0d8ce8af79e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:15.117225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d2280e5c-805d-4223-a367-c0d8ce8af79e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:15.131015 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d2280e5c-805d-4223-a367-c0d8ce8af79e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1094 microversion: 2.1 time: 0.103940 Jul 19 21:02:15.132747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 392/791] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:15 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:15.394804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-ea63f1f6-5f99-42cf-9afe-538cbb65a7f2 req-8870ed43-0c6d-42ad-b0f3-5b6a3c38bab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:15.405481 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-ea63f1f6-5f99-42cf-9afe-538cbb65a7f2 req-8870ed43-0c6d-42ad-b0f3-5b6a3c38bab4 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:15.406080 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-ea63f1f6-5f99-42cf-9afe-538cbb65a7f2 req-8870ed43-0c6d-42ad-b0f3-5b6a3c38bab4 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:15.421546 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-ea63f1f6-5f99-42cf-9afe-538cbb65a7f2 req-8870ed43-0c6d-42ad-b0f3-5b6a3c38bab4 service nova] Creating event network-changed:f425b1ee-f44a-45dc-b4ef-247a915d2a5f for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 on hv-cinder-74915 Jul 19 21:02:15.429198 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-ea63f1f6-5f99-42cf-9afe-538cbb65a7f2 req-8870ed43-0c6d-42ad-b0f3-5b6a3c38bab4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039359 Jul 19 21:02:15.430100 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 400/792] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:02:16.156046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:16.156986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:16.165661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:16.166406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:16.167906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:16.169195 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:16.279588 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:16.301068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-464ae874-5306-418c-a5cc-403d769c1f13 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1200 microversion: 2.1 time: 0.150816 Jul 19 21:02:16.319548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 393/793] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:16 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1200 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:17.338822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:17.342868 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:17.367318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:17.368534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:17.370286 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:17.371343 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:17.634838 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:17.643487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5eb34fee-eb47-44a4-b015-943087533fc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1278 microversion: 2.1 time: 0.319316 Jul 19 21:02:17.644074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 401/794] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:17 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:18.301416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e45e7a54-02ca-475c-84a4-8e230421aa19 req-0f9ee844-984a-4c74-b1ad-3c5bab6895ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c127c65-a754-40a2-ad08-ae0ce383d3f1", "tag": "c560ed26-06c1-4b1a-b002-d91cd631f59c"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:18.317645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e45e7a54-02ca-475c-84a4-8e230421aa19 req-0f9ee844-984a-4c74-b1ad-3c5bab6895ab service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:18.318548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e45e7a54-02ca-475c-84a4-8e230421aa19 req-0f9ee844-984a-4c74-b1ad-3c5bab6895ab service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:18.354113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e45e7a54-02ca-475c-84a4-8e230421aa19 req-0f9ee844-984a-4c74-b1ad-3c5bab6895ab service nova] Creating event network-changed:c560ed26-06c1-4b1a-b002-d91cd631f59c for instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 on hv-cinder-74915 Jul 19 21:02:18.364594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e45e7a54-02ca-475c-84a4-8e230421aa19 req-0f9ee844-984a-4c74-b1ad-3c5bab6895ab service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066809 Jul 19 21:02:18.366404 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 394/795] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:18.662843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:18.664508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:18.667627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:18.675427 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:18.676073 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:18.677204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:18.677757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:18.885438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:18.894296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b8bbf8ed-fe4d-4a77-b00d-be5051293872 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.235902 Jul 19 21:02:18.895046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 402/796] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:18 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:19.916191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:19.917008 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:19.923924 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:19.924512 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:19.925435 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:19.926316 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:19.962586 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:20.106534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:20.114955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4c48af2b-cfda-4546-88d1-39aedeabccae tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.204333 Jul 19 21:02:20.115612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 395/797] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:19 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:21.134002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:21.134693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:21.142360 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:21.143058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:21.144118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:21.144809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:21.335886 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:21.344786 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6f4095d6-e5dc-4b0b-82a3-63fecab6a2e1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.214749 Jul 19 21:02:21.345602 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 403/798] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:21 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:22.363841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:22.364677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:22.374109 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:22.374836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:22.376068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:22.376675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:22.553550 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:22.566749 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6d0982b3-c955-45f1-8f99-2047549b62e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.206577 Jul 19 21:02:22.567366 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 396/799] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:22 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:23.585721 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:23.586634 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:23.594856 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:23.595356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:23.596228 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:23.596746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:23.762825 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:23.772280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-05ec04e0-82fd-4872-8a3a-2d54c1b6ca0d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.191275 Jul 19 21:02:23.773575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 404/800] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:23 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:24.790903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:24.791611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:24.799293 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:24.799797 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:24.800645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:24.801087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:24.980691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:24.989078 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b598f9c4-aed3-4767-a688-8b99e9eea18b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.202814 Jul 19 21:02:24.989732 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 397/801] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:24 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:26.007880 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:26.008628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:26.011012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:26.011701 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=6 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:26.018950 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:26.019393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:26.020191 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:26.020794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:26.181609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:26.190562 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-742fc486-b8c7-45e1-9fa2-7afda23f3422 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.187197 Jul 19 21:02:26.191750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 405/802] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:26 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:27.211428 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:27.212049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:27.214306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:27.220592 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:27.221046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:27.221838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:27.222267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:27.402721 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:27.411785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1a637fe7-201e-4982-a1ae-049066537964 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.205104 Jul 19 21:02:27.412398 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 398/803] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:27 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:28.442638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:28.443715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:28.453482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:28.453959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:28.454925 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:28.455411 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:28.611312 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:28.620012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-43373c5c-723a-4b8e-858c-a94a36fba749 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.184938 Jul 19 21:02:28.620656 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 406/804] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:28 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:29.638245 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:29.638865 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:29.645831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:29.646277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:29.647063 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:29.647499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:29.846590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:29.862712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f6ed6c04-aa36-4de1-a612-dcecc24cb6c8 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.228096 Jul 19 21:02:29.863815 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 399/805] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:29 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:30.891304 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:30.892019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:30.899486 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:30.899997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:30.900853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:30.901342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:31.063742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:31.072531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e0f8d3a3-32c1-496b-9f2b-ae234672fdaa tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.186078 Jul 19 21:02:31.073138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 407/806] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:30 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:31.375058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-de17e2bb-257e-4f2a-8e3a-44cdea441d23 req-c04024d6-c219-4c17-87d5-5f70d6fa2db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c127c65-a754-40a2-ad08-ae0ce383d3f1", "name": "network-vif-plugged", "status": "completed", "tag": "c560ed26-06c1-4b1a-b002-d91cd631f59c"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:31.388266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-de17e2bb-257e-4f2a-8e3a-44cdea441d23 req-c04024d6-c219-4c17-87d5-5f70d6fa2db7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:31.389032 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-de17e2bb-257e-4f2a-8e3a-44cdea441d23 req-c04024d6-c219-4c17-87d5-5f70d6fa2db7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:31.411846 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-de17e2bb-257e-4f2a-8e3a-44cdea441d23 req-c04024d6-c219-4c17-87d5-5f70d6fa2db7 service nova] Creating event network-vif-plugged:c560ed26-06c1-4b1a-b002-d91cd631f59c for instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 on hv-cinder-74915 Jul 19 21:02:31.421450 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-de17e2bb-257e-4f2a-8e3a-44cdea441d23 req-c04024d6-c219-4c17-87d5-5f70d6fa2db7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050118 Jul 19 21:02:31.422886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 400/807] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:32.091259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:32.091892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:32.101356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:32.101875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:32.102775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:32.103323 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:32.311726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:32.320425 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d3a814c4-883e-4849-a874-8f930a9bf649 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.233843 Jul 19 21:02:32.321029 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 408/808] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:32 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:33.345332 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:33.346026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:33.354373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:33.354845 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:33.355613 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:33.356048 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:33.542595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:33.552320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b2c4e3af-f489-4454-b4be-55db82ea6280 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1266 microversion: 2.1 time: 0.213574 Jul 19 21:02:33.552955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 401/809] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:33 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:34.577604 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:34.578229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:34.585229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:34.585680 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:34.586473 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:34.586905 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:34.735564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:34.744537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e26066c6-ba72-4adf-bbbf-43103273df64 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1451 microversion: 2.1 time: 0.171488 Jul 19 21:02:34.745136 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 409/810] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:34 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:34.761323 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:34.761950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:34.769658 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:34.770256 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:34.771085 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:34.771522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:34.928136 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:34.936925 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4b04c76c-880d-4cd5-b9a0-7f684b2ba156 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1451 microversion: 2.1 time: 0.179836 Jul 19 21:02:34.937540 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 402/811] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:34 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:36.891658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-c55e38c7-5f93-4050-a812-aea1bb33215a req-faecc9cb-321b-4b8b-b240-40defe232a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c127c65-a754-40a2-ad08-ae0ce383d3f1", "tag": "c560ed26-06c1-4b1a-b002-d91cd631f59c"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:36.901980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-c55e38c7-5f93-4050-a812-aea1bb33215a req-faecc9cb-321b-4b8b-b240-40defe232a76 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:36.902674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-c55e38c7-5f93-4050-a812-aea1bb33215a req-faecc9cb-321b-4b8b-b240-40defe232a76 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:36.915885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-c55e38c7-5f93-4050-a812-aea1bb33215a req-faecc9cb-321b-4b8b-b240-40defe232a76 service nova] Creating event network-changed:c560ed26-06c1-4b1a-b002-d91cd631f59c for instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 on hv-cinder-74915 Jul 19 21:02:36.922595 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-c55e38c7-5f93-4050-a812-aea1bb33215a req-faecc9cb-321b-4b8b-b240-40defe232a76 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034837 Jul 19 21:02:36.923377 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 410/812] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:45.641317 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:45.642169 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:45.644589 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=31 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:45.645263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=40 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:45.651622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:45.652070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:45.653077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:45.653814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:45.743468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lazy-loading 'services' on Instance uuid cd76a68e-63b0-4834-8f93-3768570ff8d4 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:02:45.889130 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-42f382e3-6e92-4809-9951-3c210ed196d7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments/ccbd0f0a-f447-4edc-94d4-52e531dd50a4" status: 202 len: 0 microversion: 2.1 time: 0.252366 Jul 19 21:02:45.889728 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 403/813] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:02:45 2022] DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments/ccbd0f0a-f447-4edc-94d4-52e531dd50a4 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:02:45.899075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:45.900093 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:45.907979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:45.908581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:45.909610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:45.910046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:45.914495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=65 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:45.946452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-20047571-8c48-4ab2-92ee-4fe319e845f3 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051765 Jul 19 21:02:45.947049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 411/814] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:02:45 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:46.967362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:46.969281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:46.980610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:46.981730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:46.983188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:46.983965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:47.029750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-34f39bd7-4798-43f7-b0f9-515cc1ae782b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072035 Jul 19 21:02:47.030336 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 404/815] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:02:46 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:02:47.127511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:47.128646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:47.137308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:47.137755 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:47.138541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:47.138975 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:47.166569 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:02:47.254027 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-66bec961-d0e4-4800-a6d1-4fe564b80729 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 204 len: 0 microversion: 2.1 time: 0.139005 Jul 19 21:02:47.254660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 412/816] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:02:47 2022] DELETE /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:02:47.264573 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:47.265339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:47.272759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:47.273208 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:47.273991 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:47.274426 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:47.425375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:47.433415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-11f7c951-985a-4cce-a46e-f6e79aa5cda1 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1689 microversion: 2.1 time: 0.172869 Jul 19 21:02:47.434077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 405/817] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:47 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:48.452751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:48.453938 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:48.464389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:48.465082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:48.466353 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:48.466989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:48.625971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:48.634154 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-891a9004-0891-48ac-aa70-1b485948b288 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1689 microversion: 2.1 time: 0.186092 Jul 19 21:02:48.634748 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 413/818] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:48 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:49.652416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:49.653241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:49.660291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:49.660781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:49.661580 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:49.662046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:49.816869 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:49.825895 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6270d95c-0ad7-4be8-a916-be514cdff6dd tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1689 microversion: 2.1 time: 0.177450 Jul 19 21:02:49.826636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 406/819] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:49 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:50.851335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:50.851999 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:50.854516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:50.861858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:50.862384 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:50.863223 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:50.863684 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:51.022678 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:51.032262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8e81b23d-94fc-4810-b1b7-a59f153b787e tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1689 microversion: 2.1 time: 0.184732 Jul 19 21:02:51.032998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 414/820] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:50 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:52.050440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:52.051475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:52.061408 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:52.062067 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:52.063100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:52.064814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:52.168644 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:52.179953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-720eaa43-b378-4baf-951e-d67caf3af170 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1622 microversion: 2.1 time: 0.133502 Jul 19 21:02:52.180898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 407/821] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:52 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1622 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:52.767380 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-0694f5ee-2936-4516-8b21-b468ac31c763 req-02f3f701-49a3-4987-9c5a-9f1d3acbb936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd76a68e-63b0-4834-8f93-3768570ff8d4", "name": "network-vif-deleted", "tag": "57db9dc8-d4a7-44fe-8eb7-411c2a063b4d"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:02:52.784939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-0694f5ee-2936-4516-8b21-b468ac31c763 req-02f3f701-49a3-4987-9c5a-9f1d3acbb936 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:52.785582 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-0694f5ee-2936-4516-8b21-b468ac31c763 req-02f3f701-49a3-4987-9c5a-9f1d3acbb936 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:52.811107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-0694f5ee-2936-4516-8b21-b468ac31c763 req-02f3f701-49a3-4987-9c5a-9f1d3acbb936 service nova] Creating event network-vif-deleted:57db9dc8-d4a7-44fe-8eb7-411c2a063b4d for instance cd76a68e-63b0-4834-8f93-3768570ff8d4 on hv-cinder-74915 Jul 19 21:02:52.820652 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-0694f5ee-2936-4516-8b21-b468ac31c763 req-02f3f701-49a3-4987-9c5a-9f1d3acbb936 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057747 Jul 19 21:02:52.821736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 415/822] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:02:53.199590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:53.200941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:53.210874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:53.211870 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:53.213195 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:53.213857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:53.278430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:53.279319 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:53.280191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lazy-loading 'fault' on Instance uuid cd76a68e-63b0-4834-8f93-3768570ff8d4 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:02:53.355410 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:53.370274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a1505a6a-2401-49a0-aa6d-0b08c89dbe71 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 200 len: 1335 microversion: 2.1 time: 0.174497 Jul 19 21:02:53.372171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 408/823] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:53 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:02:54.397927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:54.399192 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: cd76a68e-63b0-4834-8f93-3768570ff8d4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:54.406746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:54.407193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:54.407979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:54.408454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:54.423618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] HTTP exception thrown: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 could not be found. Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Request method failure captured: Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 HTTP/1.1 Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xqT9co5naxXFhA9K13IQga4rr_hUZX35aVEz2GGVsCoUCqXAjJBjJ2ivspknwRZQcTuQ1wooqOLTAVyzdDxD0xAct4gGNGWkTF5OlxYJzhc6hd3pQiKdDbTyEsPppLByfrxyn_ggwbUs37R21bPUbWmx5QcOloTSTm6AmC8LH8KBo8 Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: d5af714b14ba471980868293588841fd Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:02:54.425338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d5af714b14ba471980868293588841fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d5af714b14ba471980868293588841fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: d5af714b14ba471980868293588841fd Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: ac1b24e50c894dcf8e887275fd91a174 Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 could not be found. Jul 19 21:02:54.428779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'cd76a68e-63b0-4834-8f93-3768570ff8d4'} Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 could not be found. Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:02:54.430247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 could not be found. Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 could not be found. Jul 19 21:02:54.432638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:02:54.434899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Returning 404 to user: Instance cd76a68e-63b0-4834-8f93-3768570ff8d4 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:02:54.434899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-22031588-c1d7-41ea-bda1-542018c6df58 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4" status: 404 len: 111 microversion: 2.1 time: 0.033827 Jul 19 21:02:54.434899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 416/824] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:54 2022] GET /compute/v2.1/servers/cd76a68e-63b0-4834-8f93-3768570ff8d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:02:54.440018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0098141a-7795-4b51-b4d9-589ff99a3ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '.version_select at 0x7f125f4fe550>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:54.461678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0098141a-7795-4b51-b4d9-589ff99a3ccf tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721467139" status: 202 len: 0 microversion: 2.1 time: 0.026181 Jul 19 21:02:54.462407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 409/825] 10.222.0.85 () {58 vars in 1220 bytes} [Tue Jul 19 21:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721467139 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:02:57.515650 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:57.516282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:57.525126 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:57.525812 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:57.526619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:57.527097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:57.555446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:02:57.653379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-732a68fa-2b87-4128-863f-6d0a2fdcf05b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 204 len: 0 microversion: 2.1 time: 0.141376 Jul 19 21:02:57.654762 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 417/826] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:02:57 2022] DELETE /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:02:57.665074 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:57.666020 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:57.673278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:57.674421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:57.675297 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:57.675932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:57.827391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:57.835622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-91e3b75b-4ffa-4ffe-a379-a860a898df89 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1509 microversion: 2.1 time: 0.175334 Jul 19 21:02:57.836192 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 410/827] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:57 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:02:58.855197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:02:58.856060 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:02:58.863516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:58.863965 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:58.864797 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:02:58.865233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:02:59.023997 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:02:59.032076 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e5be2a19-901b-4ee4-a46c-77ce4dc72c3a tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1509 microversion: 2.1 time: 0.181467 Jul 19 21:02:59.032698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 418/828] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:02:58 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:00.020026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-daf886bd-dd17-4d39-9a7f-7197a0490008 req-dee5b412-f5ea-4406-88b6-c92b792596cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8ed827-778b-49c4-bcf7-f961fc9f6666", "name": "network-vif-deleted", "tag": "e7821998-b80f-494c-a63a-f62d3b8dff51"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:00.034553 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-daf886bd-dd17-4d39-9a7f-7197a0490008 req-dee5b412-f5ea-4406-88b6-c92b792596cf service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:00.035187 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-daf886bd-dd17-4d39-9a7f-7197a0490008 req-dee5b412-f5ea-4406-88b6-c92b792596cf service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:00.058890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-daf886bd-dd17-4d39-9a7f-7197a0490008 req-dee5b412-f5ea-4406-88b6-c92b792596cf service nova] Creating event network-vif-deleted:e7821998-b80f-494c-a63a-f62d3b8dff51 for instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 on hv-cinder-74915 Jul 19 21:03:00.063362 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:00.065850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:00.068775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-daf886bd-dd17-4d39-9a7f-7197a0490008 req-dee5b412-f5ea-4406-88b6-c92b792596cf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052735 Jul 19 21:03:00.069533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 411/829] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:00.091419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:00.092739 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:00.094445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:00.097014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:00.188830 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:00.202895 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e87821fa-54b9-41ca-90ef-e3f1bbf3821b tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 200 len: 1293 microversion: 2.1 time: 0.155010 Jul 19 21:03:00.203657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 419/830] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:00 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:01.225858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:01.226742 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: ec8ed827-778b-49c4-bcf7-f961fc9f6666] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:01.233761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:01.234202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.234988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:01.235512 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.252088 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] HTTP exception thrown: Instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 could not be found. Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Request method failure captured: Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 HTTP/1.1 Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xqT9co5naxXFhA9K13IQga4rr_hUZX35aVEz2GGVsCoUCqXAjJBjJ2ivspknwRZQcTuQ1wooqOLTAVyzdDxD0xAct4gGNGWkTF5OlxYJzhc6hd3pQiKdDbTyEsPppLByfrxyn_ggwbUs37R21bPUbWmx5QcOloTSTm6AmC8LH8KBo8 Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: d5af714b14ba471980868293588841fd Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:03:01.253805 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d5af714b14ba471980868293588841fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d5af714b14ba471980868293588841fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: d5af714b14ba471980868293588841fd Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: ac1b24e50c894dcf8e887275fd91a174 Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 could not be found. Jul 19 21:03:01.255835 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'ec8ed827-778b-49c4-bcf7-f961fc9f6666'} Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 could not be found. Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:01.257242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 could not be found. Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 could not be found. Jul 19 21:03:01.259522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:01.261838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Returning 404 to user: Instance ec8ed827-778b-49c4-bcf7-f961fc9f6666 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:01.261838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f0e78d72-2549-47c8-84b2-397e565183c5 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666" status: 404 len: 111 microversion: 2.1 time: 0.035080 Jul 19 21:03:01.261838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 412/831] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:01 2022] GET /compute/v2.1/servers/ec8ed827-778b-49c4-bcf7-f961fc9f6666 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:03:01.265893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:01.266506 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:01.274716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:01.275259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.276096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:01.276614 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.306359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:03:01.397877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2ff7cd8a-2626-4ae0-add5-00ffa8ccfe59 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 204 len: 0 microversion: 2.1 time: 0.136251 Jul 19 21:03:01.398642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 420/832] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:03:01 2022] DELETE /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:03:01.412065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:01.413247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:01.424571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:01.425372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.426816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:01.427608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:01.627280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:01.636644 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a4a2c2ed-59d2-466c-b0e9-ffc2ff41c835 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.231955 Jul 19 21:03:01.637287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 413/833] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:01 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:02.655034 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:02.655635 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:02.662640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:02.663543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:02.664149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:02.664666 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:02.820715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:02.828746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bf55ff50-2bb7-47f2-80ef-38fc40fb0735 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.178011 Jul 19 21:03:02.829335 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 421/834] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:02 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:03.849564 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:03.850505 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:03.857854 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:03.858213 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:03.859020 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:03.859464 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:04.061090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:04.070443 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c406406d-3e7d-41de-8cbd-2799c6ab0428 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1521 microversion: 2.1 time: 0.225212 Jul 19 21:03:04.071051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 414/835] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:03 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:04.972135 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-63633e50-7baa-4fa5-b2fe-336676d557a7 req-e4cd9b98-c4a6-4989-867c-c44714e94d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4180f91-4020-48ce-ad4c-be5c214df7e2", "name": "network-vif-deleted", "tag": "06728cc2-3664-4d69-baa1-c93eec930eb2"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:04.983613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-63633e50-7baa-4fa5-b2fe-336676d557a7 req-e4cd9b98-c4a6-4989-867c-c44714e94d9d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:04.984059 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-63633e50-7baa-4fa5-b2fe-336676d557a7 req-e4cd9b98-c4a6-4989-867c-c44714e94d9d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:04.996940 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-63633e50-7baa-4fa5-b2fe-336676d557a7 req-e4cd9b98-c4a6-4989-867c-c44714e94d9d service nova] Creating event network-vif-deleted:06728cc2-3664-4d69-baa1-c93eec930eb2 for instance e4180f91-4020-48ce-ad4c-be5c214df7e2 on hv-cinder-74915 Jul 19 21:03:05.002600 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-63633e50-7baa-4fa5-b2fe-336676d557a7 req-e4cd9b98-c4a6-4989-867c-c44714e94d9d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034233 Jul 19 21:03:05.003267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 422/836] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:05.089361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:05.090497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:05.098782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:05.099339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:05.100604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:05.101044 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:05.146944 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:05.147755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:05.149038 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lazy-loading 'fault' on Instance uuid e4180f91-4020-48ce-ad4c-be5c214df7e2 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:03:05.208091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac1b24e50c894dcf8e887275fd91a174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5af714b14ba471980868293588841fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:05.219903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-55ff7628-5d5d-4875-a44d-b74bfbe829e7 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 200 len: 1311 microversion: 2.1 time: 0.135500 Jul 19 21:03:05.220931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 415/837] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:05 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:03:06.248438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:06.250199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] [instance: e4180f91-4020-48ce-ad4c-be5c214df7e2] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:06.262352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:06.263105 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:06.264800 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:06.265557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:06.294491 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] HTTP exception thrown: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 could not be found. Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Request method failure captured: Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 HTTP/1.1 Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xqT9co5naxXFhA9K13IQga4rr_hUZX35aVEz2GGVsCoUCqXAjJBjJ2ivspknwRZQcTuQ1wooqOLTAVyzdDxD0xAct4gGNGWkTF5OlxYJzhc6hd3pQiKdDbTyEsPppLByfrxyn_ggwbUs37R21bPUbWmx5QcOloTSTm6AmC8LH8KBo8 Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: d5af714b14ba471980868293588841fd Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:03:06.297778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/d5af714b14ba471980868293588841fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/d5af714b14ba471980868293588841fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_d5af714b14ba471980868293588841fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: d5af714b14ba471980868293588841fd Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-86722684 Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: ac1b24e50c894dcf8e887275fd91a174 Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-ServerRescueNegativeTestJSON-86722684-project Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 could not be found. Jul 19 21:03:06.300313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'e4180f91-4020-48ce-ad4c-be5c214df7e2'} Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 could not be found. Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:06.301729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 could not be found. Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 could not be found. Jul 19 21:03:06.303294 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:06.304730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] Returning 404 to user: Instance e4180f91-4020-48ce-ad4c-be5c214df7e2 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:06.304730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-665c6b7c-76a0-4f46-9b26-c03baec90421 tempest-ServerRescueNegativeTestJSON-86722684 tempest-ServerRescueNegativeTestJSON-86722684-project] 10.222.0.85 "GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2" status: 404 len: 111 microversion: 2.1 time: 0.060513 Jul 19 21:03:06.304730 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 423/838] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:06 2022] GET /compute/v2.1/servers/e4180f91-4020-48ce-ad4c-be5c214df7e2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:03:12.434473 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b7cbc762-fcad-4d7d-935c-4cafa2d7341c tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Action: 'create', calling method: .version_select at 0x7f125f5af0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-846339055", "metadata": {"Type": "work"}}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b7cbc762-fcad-4d7d-935c-4cafa2d7341c tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Request method failure captured: Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 121 Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xwQ6zCxEpvwShj7aCVyOs0qNf_q4JE6oqReeUiswXYctPE2DBMw8o9RRq3ZEE0d4jRrje6zpyGy9EP6Nmtct3qn_oT-ZIqPjUhn9FpF6o3__XSrsMKTM1AbQBwOZEPDeh3DpUn47BHzwTx2CPHfEpab7CNlt3HPolA59vHHAeKpYJc Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:03:12.453706 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 47205be3ce2f452f9af44b6c079b430e Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-846339055", "metadata": {"Type": "work"}}} Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 21:03:12.455864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-846339055', 'metadata': {'Type': 'work'}}}} Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise error Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:12.457312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 21:03:12.460102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 21:03:12.462248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 21:03:12.462248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.462248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b7cbc762-fcad-4d7d-935c-4cafa2d7341c tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:12.462248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b7cbc762-fcad-4d7d-935c-4cafa2d7341c tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.210494 Jul 19 21:03:12.462248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 416/839] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jul 19 21:03:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:03:12.469403 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c725797-60af-477a-b5d6-755f6f580453 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Action: 'create', calling method: .version_select at 0x7f125f45a4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-147664679", "metadata": {"Type": "work"}}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c725797-60af-477a-b5d6-755f6f580453 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Request method failure captured: Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 119 Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xwQ6zCxEpvwShj7aCVyOs0qNf_q4JE6oqReeUiswXYctPE2DBMw8o9RRq3ZEE0d4jRrje6zpyGy9EP6Nmtct3qn_oT-ZIqPjUhn9FpF6o3__XSrsMKTM1AbQBwOZEPDeh3DpUn47BHzwTx2CPHfEpab7CNlt3HPolA59vHHAeKpYJc Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:03:12.472901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 47205be3ce2f452f9af44b6c079b430e Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-147664679", "metadata": {"Type": "work"}}} Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: Jul 19 21:03:12.476254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-147664679', 'metadata': {'Type': 'work'}}}} Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise error Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi '0' Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:12.477865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 21:03:12.480727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 21:03:12.482871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 21:03:12.482871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.482871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9c725797-60af-477a-b5d6-755f6f580453 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:12.482871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9c725797-60af-477a-b5d6-755f6f580453 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009535 Jul 19 21:03:12.482871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 424/840] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jul 19 21:03:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:03:12.487840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-076cd3df-d69b-47a0-b67c-643c8d5634ba tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Action: 'create', calling method: .version_select at 0x7f125f5ad5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1082362408", "metadata": {"Type": "work"}}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-076cd3df-d69b-47a0-b67c-643c8d5634ba tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Request method failure captured: Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 119 Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xwQ6zCxEpvwShj7aCVyOs0qNf_q4JE6oqReeUiswXYctPE2DBMw8o9RRq3ZEE0d4jRrje6zpyGy9EP6Nmtct3qn_oT-ZIqPjUhn9FpF6o3__XSrsMKTM1AbQBwOZEPDeh3DpUn47BHzwTx2CPHfEpab7CNlt3HPolA59vHHAeKpYJc Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:03:12.490500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 47205be3ce2f452f9af44b6c079b430e Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1082362408", "metadata": {"Type": "work"}}} Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 21:03:12.493437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1082362408', 'metadata': {'Type': 'work'}}}} Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise error Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi '' Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:12.494803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 21:03:12.497953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 21:03:12.500611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 21:03:12.500611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.500611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-076cd3df-d69b-47a0-b67c-643c8d5634ba tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:12.500611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-076cd3df-d69b-47a0-b67c-643c8d5634ba tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010597 Jul 19 21:03:12.500611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 417/841] 10.222.0.85 () {60 vars in 1155 bytes} [Tue Jul 19 21:03:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:03:12.505203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a7b21af-effc-41a6-b80b-ef871149ffd0 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Calling method '.version_select at 0x7f125f3428b0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:12.539270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-7a7b21af-effc-41a6-b80b-ef871149ffd0 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] HTTP exception thrown: Volume tempest-invalid-1590859647 could not be found. Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a7b21af-effc-41a6-b80b-ef871149ffd0 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Request method failure captured: Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1590859647 HTTP/1.1 Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xwQ6zCxEpvwShj7aCVyOs0qNf_q4JE6oqReeUiswXYctPE2DBMw8o9RRq3ZEE0d4jRrje6zpyGy9EP6Nmtct3qn_oT-ZIqPjUhn9FpF6o3__XSrsMKTM1AbQBwOZEPDeh3DpUn47BHzwTx2CPHfEpab7CNlt3HPolA59vHHAeKpYJc Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:03:12.542702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 47205be3ce2f452f9af44b6c079b430e Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Volume tempest-invalid-1590859647 could not be found. Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'tempest-invalid-1590859647'} Jul 19 21:03:12.544419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1590859647 could not be found. (HTTP 404) (Request-ID: req-7afbdd7c-ec0e-43c9-a470-fe0ae2d8028e) Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.545516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 21:03:12.547798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1590859647 could not be found. Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:12.550307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1590859647 could not be found. Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1590859647 could not be found. Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7a7b21af-effc-41a6-b80b-ef871149ffd0 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Returning 404 to user: Volume tempest-invalid-1590859647 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7a7b21af-effc-41a6-b80b-ef871149ffd0 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1590859647" status: 404 len: 99 microversion: 2.1 time: 0.045011 Jul 19 21:03:12.553222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 425/842] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jul 19 21:03:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1590859647 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 19 21:03:12.558020 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-91fb01e0-e7e9-4bb6-b233-b0b0781c3b29 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005790 Jul 19 21:03:12.558743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 418/843] 10.222.0.85 () {58 vars in 1139 bytes} [Tue Jul 19 21:03:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 19 21:03:12.569640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-701cc5d8-7a39-4c17-8d8e-fef54c9b71d3 tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005123 Jul 19 21:03:12.570343 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 426/844] 10.222.0.85 () {58 vars in 1136 bytes} [Tue Jul 19 21:03:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 21:03:12.580678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3487eb44-91c9-4bc5-873e-cb2dbefc573d tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Calling method '.version_select at 0x7f125f5adb80>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:12.611625 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-3487eb44-91c9-4bc5-873e-cb2dbefc573d tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] HTTP exception thrown: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3487eb44-91c9-4bc5-873e-cb2dbefc573d tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Request method failure captured: Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: DELETE /compute/v2.1/os-volumes/559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 HTTP/1.1 Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xwQ6zCxEpvwShj7aCVyOs0qNf_q4JE6oqReeUiswXYctPE2DBMw8o9RRq3ZEE0d4jRrje6zpyGy9EP6Nmtct3qn_oT-ZIqPjUhn9FpF6o3__XSrsMKTM1AbQBwOZEPDeh3DpUn47BHzwTx2CPHfEpab7CNlt3HPolA59vHHAeKpYJc Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:03:12.613666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 47205be3ce2f452f9af44b6c079b430e Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07'} Jul 19 21:03:12.615311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. (HTTP 404) (Request-ID: req-ca4a4c2b-44c0-43f4-9170-9d42e34bfa42) Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.616284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 21:03:12.617993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 21:03:12.619453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3487eb44-91c9-4bc5-873e-cb2dbefc573d tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Returning 404 to user: Volume 559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3487eb44-91c9-4bc5-873e-cb2dbefc573d tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07" status: 404 len: 109 microversion: 2.1 time: 0.038552 Jul 19 21:03:12.621124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 419/845] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 21:03:12 2022] DELETE /compute/v2.1/os-volumes/559f35ee-eaf4-4f24-a3c4-ddc6c2e60a07 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:03:12.629047 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e0b1608-0ba0-4280-a448-4ad40332115f tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Calling method '.version_select at 0x7f125f3425e0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:12.660038 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-4e0b1608-0ba0-4280-a448-4ad40332115f tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] HTTP exception thrown: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e0b1608-0ba0-4280-a448-4ad40332115f tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Request method failure captured: Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/os-volumes/7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 HTTP/1.1 Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xwQ6zCxEpvwShj7aCVyOs0qNf_q4JE6oqReeUiswXYctPE2DBMw8o9RRq3ZEE0d4jRrje6zpyGy9EP6Nmtct3qn_oT-ZIqPjUhn9FpF6o3__XSrsMKTM1AbQBwOZEPDeh3DpUn47BHzwTx2CPHfEpab7CNlt3HPolA59vHHAeKpYJc Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:03:12.662145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e76e331e55014bd98d8a88e1be06b038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: e76e331e55014bd98d8a88e1be06b038 Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-VolumesNegativeTest-1450652486 Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 47205be3ce2f452f9af44b6c079b430e Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-VolumesNegativeTest-1450652486-project Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '7b5a08d3-e51d-4eed-8a86-26101dc8c8f6'} Jul 19 21:03:12.663615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. (HTTP 404) (Request-ID: req-d8cedb03-1dac-48d6-92c9-b16890c333aa) Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.664638 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 21:03:12.666166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 21:03:12.668006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4e0b1608-0ba0-4280-a448-4ad40332115f tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] Returning 404 to user: Volume 7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4e0b1608-0ba0-4280-a448-4ad40332115f tempest-VolumesNegativeTest-1450652486 tempest-VolumesNegativeTest-1450652486-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/7b5a08d3-e51d-4eed-8a86-26101dc8c8f6" status: 404 len: 109 microversion: 2.1 time: 0.038643 Jul 19 21:03:12.669210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 427/846] 10.222.0.85 () {58 vars in 1244 bytes} [Tue Jul 19 21:03:12 2022] GET /compute/v2.1/os-volumes/7b5a08d3-e51d-4eed-8a86-26101dc8c8f6 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:03:41.556476 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.557823 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.566885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:41.568503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:41.585858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:41.587163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:41.588827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:41.589639 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:41.632986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-58c1f1d1-1d9c-437c-a82e-0ceb1d71afbc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/ips" status: 200 len: 149 microversion: 2.1 time: 0.079467 Jul 19 21:03:41.633882 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 420/847] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 21:03:41 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:41.704379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.708101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:03:41.715733 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:41.716915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:41.728699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:41.729352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:41.730495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:41.731083 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:41.767798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a71d37e5-ac26-4b32-8ad3-6d6517e3d205 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/ips" status: 200 len: 151 microversion: 2.20 time: 0.065594 Jul 19 21:03:41.768762 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 428/848] 10.222.0.85 () {60 vars in 1288 bytes} [Tue Jul 19 21:03:41 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/ips => generated 151 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 21:03:44.217654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce3e34d-9a76-4a77-ab54-2606b96ae11f"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:44.219755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:44.228222 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:44.229249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:44.230266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:44.230875 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:44.618866 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-549bb5e9-cabb-4912-ad5a-7700c32dc329 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407118 Jul 19 21:03:44.627818 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 421/849] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:03:44 2022] POST /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:03:46.086148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:46.086947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:46.097791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:46.098418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:46.100364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:46.101438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:46.134908 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lazy-loading 'flavor' on Instance uuid bb7bb733-32bd-48a4-9c5d-771b2c658ad1 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:03:46.476503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ea45612b-9bf5-421c-b28d-cd9232aecc03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/action" status: 202 len: 0 microversion: 2.20 time: 0.396362 Jul 19 21:03:46.477160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 429/850] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jul 19 21:03:46 2022] POST /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:03:46.493390 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:46.495775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:46.508144 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:46.509077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:46.510610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:46.511265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:46.718596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:46.729727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:46.731429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:46.732730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ddd2a7f0-37c9-4335-ad3b-9e0a25f74dab tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.248381 Jul 19 21:03:46.733307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 422/851] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:46 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:03:47.764630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:47.765540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:47.772999 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:47.773494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:47.774693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:47.775291 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:47.945276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:47.956442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:47.959171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:47.960553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7b27dbd5-16d7-4bf9-a9cd-0611159f0f03 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.201662 Jul 19 21:03:47.961271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 430/852] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:47 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:03:48.981670 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:48.982619 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:48.989547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:48.989999 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:48.990816 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:48.991277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:49.177537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:49.187073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:49.188605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:49.189802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b66314e3-640f-4c89-85fe-8d2bad396eae tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.212306 Jul 19 21:03:49.190451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 423/853] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:48 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:03:50.213173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:50.214242 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:50.225644 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.226346 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.227526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:50.228206 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:50.391541 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:50.401093 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:50.402649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:50.403874 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a67d3102-8612-4056-b4e9-d55bd9ff22f9 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.197093 Jul 19 21:03:50.404480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 431/854] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:50 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:03:51.422207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:51.422843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:51.430082 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:51.430541 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:51.431644 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:51.432112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:51.673655 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:51.688660 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:51.691755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:51.694797 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0d629f87-c30d-42e3-a7dd-9efa01d08f5b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.276089 Jul 19 21:03:51.695837 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 424/855] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:51 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:03:52.730042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:52.730758 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:52.738872 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.739641 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.745527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:52.746378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:52.943687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:52.958454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:52.961540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:52.963809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c06cf505-c964-45be-a146-5fab4e1fce1c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.244201 Jul 19 21:03:52.964921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 432/856] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:52 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:03:53.461418 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce3e34d-9a76-4a77-ab54-2606b96ae11f"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:53.462593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:53.470576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.471348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.472570 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.473040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.570006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Invalid volume: volume 3ce3e34d-9a76-4a77-ab54-2606b96ae11f is already attached to instances: 4bcd3d43-1700-4062-b83f-6a1851ae44bd Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: POST /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments HTTP/1.1 Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 74 Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:03:53.571804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {"volumeAttachment": {"volumeId": "3ce3e34d-9a76-4a77-ab54-2606b96ae11f"}} Jul 19 21:03:53.574578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Invalid volume: volume 3ce3e34d-9a76-4a77-ab54-2606b96ae11f is already attached to instances: 4bcd3d43-1700-4062-b83f-6a1851ae44bd Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'server_id': '4bcd3d43-1700-4062-b83f-6a1851ae44bd', 'body': {'volumeAttachment': {'volumeId': '3ce3e34d-9a76-4a77-ab54-2606b96ae11f'}}} Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3ce3e34d-9a76-4a77-ab54-2606b96ae11f is already attached to instances: 4bcd3d43-1700-4062-b83f-6a1851ae44bd Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.576049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3ce3e34d-9a76-4a77-ab54-2606b96ae11f is already attached to instances: 4bcd3d43-1700-4062-b83f-6a1851ae44bd Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:03:53.578430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3ce3e34d-9a76-4a77-ab54-2606b96ae11f is already attached to instances: 4bcd3d43-1700-4062-b83f-6a1851ae44bd Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 400 to user: Invalid volume: volume 3ce3e34d-9a76-4a77-ab54-2606b96ae11f is already attached to instances: 4bcd3d43-1700-4062-b83f-6a1851ae44bd {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-23c048bf-1721-418f-b3e7-aa7bd0d29555 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116905 Jul 19 21:03:53.582385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 425/857] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:03:53 2022] POST /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:03:53.655495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:53.656004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:53.664666 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.664971 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.666034 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.666695 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.804050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'services' on Instance uuid 4bcd3d43-1700-4062-b83f-6a1851ae44bd {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:03:53.931618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e47a503a-9415-4daa-ad43-dca34699e522 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments/3ce3e34d-9a76-4a77-ab54-2606b96ae11f" status: 202 len: 0 microversion: 2.1 time: 0.280586 Jul 19 21:03:53.932308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 433/858] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:03:53 2022] DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments/3ce3e34d-9a76-4a77-ab54-2606b96ae11f => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:03:53.955525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:53.957100 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:53.976020 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.977600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:53.979447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:53.980641 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:54.014343 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:54.015913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:54.036814 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:54.038504 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:54.041310 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:54.042379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:54.045919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-96f82e76-9811-4f04-96cf-a0d4acc1da41 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107000 Jul 19 21:03:54.047134 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 426/859] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:03:53 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:54.297181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:54.312584 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:54.315879 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:54.319240 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eb8be691-9530-4ca1-9773-7895e166b14a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.334589 Jul 19 21:03:54.320274 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 434/860] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:53 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:03:55.061578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:55.062664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:55.069878 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.070326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.071128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.071567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.105238 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fafdd54d-0174-40a2-93fd-47a81255125d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048629 Jul 19 21:03:55.105866 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 427/861] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:03:55 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 21:03:55.178443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:55.179074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:55.186063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.186502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.187308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.187743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.220345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:03:55.310628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e498740e-f8bf-4c0d-a7cf-0657cf74d65e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 204 len: 0 microversion: 2.1 time: 0.135584 Jul 19 21:03:55.311618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 435/862] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:03:55 2022] DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 21:03:55.324851 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:55.325527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:55.334138 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.334847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.335836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.336427 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.343046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:55.343046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:55.350365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.350911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.351769 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:55.352257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:55.573118 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:55.579275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:55.586554 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-49f4edbe-7e10-45dc-8f2a-cfcaa130d08b tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1681 microversion: 2.1 time: 0.269381 Jul 19 21:03:55.587533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 428/863] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:55 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:55.594611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:55.597840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:55.600782 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-97a46ea7-ccce-419d-8164-9318f382a91a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.264014 Jul 19 21:03:55.601885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 436/864] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:55 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:03:56.613909 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:56.613909 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:56.619977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:56.620533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:56.620817 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:56.621745 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:56.621964 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:56.622200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:56.631065 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:56.631649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:56.632605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:56.633159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:56.870798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:56.879536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:56.884001 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c0aa0662-6258-40cd-8a8a-16e3006c3c5f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1681 microversion: 2.1 time: 0.275206 Jul 19 21:03:56.885137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 429/865] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:56 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:56.891668 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:56.893652 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:56.895128 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ddcd813d-8f5e-496c-8af5-607457eb0e5d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.279439 Jul 19 21:03:56.895829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 437/866] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:56 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:03:57.910722 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:57.912616 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:57.921824 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:57.923559 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:57.924117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:57.924492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:57.925197 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:57.925705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:57.933418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:57.934334 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:57.935276 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:57.935823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:58.118497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:58.133951 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0e691bac-6767-4c4a-8717-85444db80f60 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1681 microversion: 2.1 time: 0.232648 Jul 19 21:03:58.140787 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 430/867] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:57 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:58.300134 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:58.316835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:58.320394 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:58.322802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c2274743-bb0a-4d34-92a5-639daace2eec tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.412124 Jul 19 21:03:58.323900 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 438/868] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:57 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:03:58.596714 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-73afba8a-229b-4d41-9c4b-3f03c64bfcc7 req-b6e763db-1626-4d92-8f86-5b81260c5a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcd3d43-1700-4062-b83f-6a1851ae44bd", "name": "network-vif-deleted", "tag": "3f062646-e05e-457c-b3f6-6fc038438287"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:03:58.623924 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-73afba8a-229b-4d41-9c4b-3f03c64bfcc7 req-b6e763db-1626-4d92-8f86-5b81260c5a5b service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:58.626348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-73afba8a-229b-4d41-9c4b-3f03c64bfcc7 req-b6e763db-1626-4d92-8f86-5b81260c5a5b service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:58.645390 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-73afba8a-229b-4d41-9c4b-3f03c64bfcc7 req-b6e763db-1626-4d92-8f86-5b81260c5a5b service nova] Creating event network-vif-deleted:3f062646-e05e-457c-b3f6-6fc038438287 for instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd on hv-cinder-74915 Jul 19 21:03:58.657981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-73afba8a-229b-4d41-9c4b-3f03c64bfcc7 req-b6e763db-1626-4d92-8f86-5b81260c5a5b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068256 Jul 19 21:03:58.665081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 431/869] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:03:59.162378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:59.163525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:59.173308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:59.177367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:59.177367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:59.177899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:59.247715 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:59.248484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:59.249283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'fault' on Instance uuid 4bcd3d43-1700-4062-b83f-6a1851ae44bd {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:03:59.303144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:59.317187 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2d46dd21-6bb5-4a3d-ba05-636ff1fa5405 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 200 len: 1331 microversion: 2.1 time: 0.160429 Jul 19 21:03:59.318526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 439/870] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:03:59 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:03:59.352259 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:03:59.353181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:03:59.360896 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:59.361354 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:59.362165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:03:59.362610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:03:59.592126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:59.601921 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:59.603640 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:03:59.605219 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f4e85080-bfe1-42ca-806d-f709c11b3378 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1743 microversion: 2.20 time: 0.257211 Jul 19 21:03:59.605447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 432/871] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:03:59 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:00.340771 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:00.341402 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:00.348364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:00.349336 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:00.350137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:00.350570 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:00.355418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:00.366207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd HTTP/1.1 Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:04:00.367882 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:04:00.371024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '4bcd3d43-1700-4062-b83f-6a1851ae44bd'} Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:04:00.373033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:04:00.375660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:04:00.377787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:04:00.377787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be8de0e7-e6e2-4834-992f-9a5da6b95caf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 404 len: 111 microversion: 2.1 time: 0.032805 Jul 19 21:04:00.377787 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 440/872] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:00 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:04:00.378647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6732fbc2-d706-48b5-925c-c8b3cbf5dcb1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '.version_select at 0x7f125f4fe550>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:00.400395 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6732fbc2-d706-48b5-925c-c8b3cbf5dcb1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-568703511" status: 202 len: 0 microversion: 2.1 time: 0.025254 Jul 19 21:04:00.400914 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 433/873] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jul 19 21:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-568703511 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:04:00.636369 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:00.637688 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:00.651665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:00.652414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:00.653951 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:00.654743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:00.950783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:00.960987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:00.962524 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:00.963747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1941f096-7f71-4a58-bb04-cae71dac97ee tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1743 microversion: 2.20 time: 0.335166 Jul 19 21:04:00.964345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 441/874] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:00 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1743 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:01.369717 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3fe6d0b4-1825-417f-95c9-deccc025914e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: .version_select at 0x7f125f5addc0>, body: {"keypair": {"name": "tempest-keypair-897443553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiLIO4VzmwcOPEM39ihcu3LxtqAFcXoz98pFEq7Ewaksy9MlV7PqyU0IrbQRYcBuHq75jRVgn2ialcSTyEnZzVuCLNmCdBcB1M6mT9Nl1J7J2JxKtuTEWo9Y6UplOJEwQ=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:01.397765 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-3fe6d0b4-1825-417f-95c9-deccc025914e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:04:01.404506 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-3fe6d0b4-1825-417f-95c9-deccc025914e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:04:01.440415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3fe6d0b4-1825-417f-95c9-deccc025914e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076247 Jul 19 21:04:01.441475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 434/875] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 21:04:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:01.915467 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-77fa5bb4-e12c-4b5a-a149-907d3400be25 req-60d00f91-28aa-40ca-ab94-059deded454b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "name": "network-vif-plugged", "status": "completed", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:01.925330 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-77fa5bb4-e12c-4b5a-a149-907d3400be25 req-60d00f91-28aa-40ca-ab94-059deded454b service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:01.925917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-77fa5bb4-e12c-4b5a-a149-907d3400be25 req-60d00f91-28aa-40ca-ab94-059deded454b service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:01.941607 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-77fa5bb4-e12c-4b5a-a149-907d3400be25 req-60d00f91-28aa-40ca-ab94-059deded454b service nova] Creating event network-vif-plugged:f425b1ee-f44a-45dc-b4ef-247a915d2a5f for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 on hv-cinder-74915 Jul 19 21:04:01.948285 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-77fa5bb4-e12c-4b5a-a149-907d3400be25 req-60d00f91-28aa-40ca-ab94-059deded454b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037529 Jul 19 21:04:01.949703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 442/876] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:01.984124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:01.985386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:02.001776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:02.004565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:02.007262 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:02.008769 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:02.255501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:02.271039 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:02.274778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:02.277494 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bccafe08-2ce5-4009-9f66-3c0578b55dac tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1743 microversion: 2.20 time: 0.298083 Jul 19 21:04:02.285975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 435/877] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:01 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:03.303277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:03.304123 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:03.312568 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:03.313261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:03.314799 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:03.315365 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:03.429997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-466600308", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96395a07-97fe-40fb-bf6f-dcb0f6511ee1"}], "security_groups": [{"name": "tempest-securitygroup--1767391014"}], "key_name": "tempest-keypair-897443553", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:03.492277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:03.502339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:03.504745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:03.507217 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-048d4251-572a-40cd-bb38-f3367aabb5bb tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1743 microversion: 2.20 time: 0.212810 Jul 19 21:04:03.508559 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 443/878] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:03 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:03.570473 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] validate_networks() for [('96395a07-97fe-40fb-bf6f-dcb0f6511ee1', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:04:04.015600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:04:04.016019 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:04:04.016556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:04:04.017244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:04:04.017959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:04:04.034426 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:04.035206 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:04.037284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:04.038043 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:04.065087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:04:04.070814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Getting quotas for user d4c6ceff33ee449193fe6d4f7b2c01ec and project 0c2f1232dd344ca7a48bf3fbc36dfb39. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:04:04.085073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:04:04.097093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:04:04.151054 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b5cfd036-e3ab-4ce3-b7cc-7f7b6c67c7dd tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725061 Jul 19 21:04:04.159348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 436/879] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:04:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:04:04.169927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c1705214-e801-4972-86da-e973bacc77ab tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:04.171392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c1705214-e801-4972-86da-e973bacc77ab tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:04.277463 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c1705214-e801-4972-86da-e973bacc77ab tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:04.287382 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c1705214-e801-4972-86da-e973bacc77ab tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1240 microversion: 2.1 time: 0.124669 Jul 19 21:04:04.288169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 444/880] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:04 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1240 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:04.539601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:04.540263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:04.549204 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:04.550080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:04.551280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:04.552611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:04.821195 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:04.848071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:04.850440 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:04.852777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1f19830f-ea69-417f-b04f-913eeba2f922 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.317353 Jul 19 21:04:04.853704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 437/881] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:04 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:05.308857 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:05.310816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:05.326671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:05.327640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:05.329196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:05.330001 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:05.480745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:05.498618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0c9fc589-a2e0-4062-9f07-db825ea3dd70 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1292 microversion: 2.1 time: 0.196533 Jul 19 21:04:05.500537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 445/882] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:05 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1292 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:05.882070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:05.887844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:05.915551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:05.915551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:05.915551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:05.915551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:06.090649 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:06.097652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:06.107537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:06.109674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:06.111221 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1a3507dd-8f84-4751-9efa-718a5bf8e452 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.238086 Jul 19 21:04:06.112046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 438/883] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:05 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:06.527593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:06.528494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:06.547543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:06.551438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:06.559125 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:06.560802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:06.938531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:06.957925 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-91b9e0e8-c7a7-4e80-8eee-ef952a72721a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.433537 Jul 19 21:04:06.968778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 446/884] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:06 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:07.135702 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:07.136778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:07.170602 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:07.171333 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:07.177122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:07.177754 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:07.459868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:07.475525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:07.480005 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:07.483076 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ff7db574-52e4-42f6-90e7-1d7c25131e64 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.355769 Jul 19 21:04:07.484603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 439/885] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:07 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:07.977585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:07.978949 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:07.986623 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:07.987363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:07.988507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:07.989199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:08.089600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-aa6ad91b-b9be-40d6-ba12-7771bdfff689 req-cf8cb1f9-dd41-4a8c-92ed-b46d3bbbd25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc42ba5e-a57c-421b-aae9-1c6919d63e78", "tag": "b80c726a-c011-4a23-986f-05bbbb3bcbda"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:08.111754 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-aa6ad91b-b9be-40d6-ba12-7771bdfff689 req-cf8cb1f9-dd41-4a8c-92ed-b46d3bbbd25c service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:08.113821 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-aa6ad91b-b9be-40d6-ba12-7771bdfff689 req-cf8cb1f9-dd41-4a8c-92ed-b46d3bbbd25c service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:08.158737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-aa6ad91b-b9be-40d6-ba12-7771bdfff689 req-cf8cb1f9-dd41-4a8c-92ed-b46d3bbbd25c service nova] Creating event network-changed:b80c726a-c011-4a23-986f-05bbbb3bcbda for instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 on hv-cinder-74915 Jul 19 21:04:08.179118 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-aa6ad91b-b9be-40d6-ba12-7771bdfff689 req-cf8cb1f9-dd41-4a8c-92ed-b46d3bbbd25c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094592 Jul 19 21:04:08.180378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 440/886] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:04:08.268361 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:08.279010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1ad1253e-dfee-4b7d-84e0-75ba657a5fe3 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.305626 Jul 19 21:04:08.280697 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 447/887] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:07 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:08.511493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:08.512284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:08.522802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:08.523491 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:08.524474 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:08.524983 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:08.749563 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:08.764229 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:08.766734 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:08.769068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ff1d872c-6973-4710-b6e0-2b2adc053e10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.261576 Jul 19 21:04:08.770283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 441/888] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:08 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:09.311734 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:09.314408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:09.328197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:09.329247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:09.330554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:09.331625 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:09.587156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:09.605904 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-304b45e1-a27f-450f-95ce-b9cc9e34dc01 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.300483 Jul 19 21:04:09.607090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 448/889] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:09 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:09.807686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:09.809813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:09.823207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:09.823993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:09.826294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:09.827120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:10.090204 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:10.100940 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:10.104305 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:10.105933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-52533817-7a2b-4761-a47b-8b1cfa3e847e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.307932 Jul 19 21:04:10.106762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 442/890] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:09 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:10.633045 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:10.633681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:10.645930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:10.647613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:10.648518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:10.649267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:10.873941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:10.883538 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-60422b20-6553-4878-a7ba-e426224d9a00 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.255382 Jul 19 21:04:10.893743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 449/891] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:10 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:11.125490 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:11.126998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:11.137709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:11.138070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:11.139113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:11.139595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:11.307573 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:11.318004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:11.319638 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:11.321060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-93a6c635-a019-4966-a57b-83d15787f5bc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.199771 Jul 19 21:04:11.324371 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 443/892] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:11 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:11.904924 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:11.906272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:11.916392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:11.923437 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:11.924350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:11.925658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:11.926319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:12.289326 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:12.310728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-232fb899-b695-4549-bed2-0b0c53dd597f tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.411931 Jul 19 21:04:12.311737 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 450/893] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:11 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:12.360000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:12.362466 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:12.371373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:12.381353 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:12.382388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:12.384375 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:12.385990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:12.587341 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:12.604365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:12.609779 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:12.613667 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3e687679-3ea0-4182-b3f4-82304d844ee5 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.266199 Jul 19 21:04:12.630274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 444/894] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:12 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:13.338229 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:13.344647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:13.363603 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:13.364096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:13.365751 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:13.366546 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:13.567606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:13.583022 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-10b4630e-20ee-4ad0-891e-b1d0de2d689c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.252013 Jul 19 21:04:13.583850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 451/895] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:13 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:13.648167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:13.649258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:13.657806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:13.658298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:13.659174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:13.659827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:13.951941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:13.967867 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:13.969748 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:13.971044 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9f5fd0f6-3214-4bdf-bf48-3071d4827dc0 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.332170 Jul 19 21:04:13.976420 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 445/896] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:13 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:14.072172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d0fc50b0-38b3-42b8-89d9-62081bae9ae0 req-834c6573-bd53-4eb3-a7ec-1212c3a07c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc42ba5e-a57c-421b-aae9-1c6919d63e78", "name": "network-vif-plugged", "status": "completed", "tag": "b80c726a-c011-4a23-986f-05bbbb3bcbda"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:14.095909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d0fc50b0-38b3-42b8-89d9-62081bae9ae0 req-834c6573-bd53-4eb3-a7ec-1212c3a07c4f service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.096825 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d0fc50b0-38b3-42b8-89d9-62081bae9ae0 req-834c6573-bd53-4eb3-a7ec-1212c3a07c4f service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.118201 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d0fc50b0-38b3-42b8-89d9-62081bae9ae0 req-834c6573-bd53-4eb3-a7ec-1212c3a07c4f service nova] Creating event network-vif-plugged:b80c726a-c011-4a23-986f-05bbbb3bcbda for instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 on hv-cinder-74915 Jul 19 21:04:14.127884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d0fc50b0-38b3-42b8-89d9-62081bae9ae0 req-834c6573-bd53-4eb3-a7ec-1212c3a07c4f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062586 Jul 19 21:04:14.130292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 452/897] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:04:14.605320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:14.605972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:14.608195 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:14.608991 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=10 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:14.618942 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.619306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.620128 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:14.620659 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:14.845067 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:14.849467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-42484af1-36b0-45c8-a3c6-f80b30b15122 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.248383 Jul 19 21:04:14.860214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 446/898] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:14 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:15.002658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:15.003804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:15.007145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:15.017096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.017676 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.018585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.019113 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.245989 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:15.271748 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:15.275331 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:15.277881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e18a5a7b-93e3-4154-9298-4faec21b9154 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.282192 Jul 19 21:04:15.279292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 453/899] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:14 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:15.867482 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:15.869035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:15.877517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.878894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:15.880230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:15.880940 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:16.098781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:16.112532 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3c8d2883-08f9-42e7-8f94-6a1fd5e30b58 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1366 microversion: 2.1 time: 0.249149 Jul 19 21:04:16.113456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 447/900] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:15 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:04:16.303057 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:16.305390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:16.318185 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:16.319389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:16.321086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:16.322694 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:16.558193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:16.568968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:16.570517 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:16.571723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b43b1e4a-525b-4218-9d02-b6b8f5d7dee6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1738 microversion: 2.20 time: 0.277042 Jul 19 21:04:16.572307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 454/901] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:16 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:17.142661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:17.143498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:17.150661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.151220 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.152053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.152715 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.325247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:17.339894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ee016f32-9cfb-4a87-8afd-c2a040496ce2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1556 microversion: 2.1 time: 0.200921 Jul 19 21:04:17.341000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 448/902] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:17 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:17.375101 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:17.376042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:17.390407 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.391214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.392974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.393696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.486065 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-080832d8-ef21-4b3c-9242-c9f9711b1dd1 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118376 Jul 19 21:04:17.486723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 455/903] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 21:04:17 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:17.606720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:17.607843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:17.617059 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.617651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.618446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:17.618916 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:17.811270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:17.822081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:17.823970 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:17.825891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-12dd5f32-20a2-4d17-9489-2b43bcf7643d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1720 microversion: 2.20 time: 0.226539 Jul 19 21:04:17.826434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 449/904] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:17 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:18.860295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:18.861465 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:18.874077 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.874869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:18.876254 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:18.877199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:19.060569 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:19.069758 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:19.071387 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:19.073167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-78edc85d-35bf-4e09-bfa0-5c8a7439438a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1720 microversion: 2.20 time: 0.221105 Jul 19 21:04:19.073779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 456/905] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:18 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:19.347391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e84b5340-fd2f-4358-892c-e4cdd9757fba req-0961f77e-06d6-4ef0-b15e-f46efd20fdae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc42ba5e-a57c-421b-aae9-1c6919d63e78", "tag": "b80c726a-c011-4a23-986f-05bbbb3bcbda"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:19.358356 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e84b5340-fd2f-4358-892c-e4cdd9757fba req-0961f77e-06d6-4ef0-b15e-f46efd20fdae service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:19.358879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e84b5340-fd2f-4358-892c-e4cdd9757fba req-0961f77e-06d6-4ef0-b15e-f46efd20fdae service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:19.375139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e84b5340-fd2f-4358-892c-e4cdd9757fba req-0961f77e-06d6-4ef0-b15e-f46efd20fdae service nova] Creating event network-changed:b80c726a-c011-4a23-986f-05bbbb3bcbda for instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 on hv-cinder-74915 Jul 19 21:04:19.381959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e84b5340-fd2f-4358-892c-e4cdd9757fba req-0961f77e-06d6-4ef0-b15e-f46efd20fdae service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038643 Jul 19 21:04:19.382810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 450/906] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:04:20.094791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:20.095875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:20.105802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:20.106147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:20.107147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:20.107694 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:20.306381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:20.320778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:20.323443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:20.325624 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6228a947-21e8-43c3-8d73-059391f16e0c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1720 microversion: 2.20 time: 0.235429 Jul 19 21:04:20.326544 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 457/907] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:20 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:21.345931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:21.346784 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:21.354840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.355306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:21.356111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.356594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:21.716650 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:21.732871 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:21.734413 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:21.735633 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-065e8fb7-d3e0-472c-9a71-90f4b75841ba tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1663 microversion: 2.20 time: 0.394685 Jul 19 21:04:21.736224 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 451/908] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:21 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1663 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:21.757859 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3a4967-fad1-411c-a69b-57080546e063"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:21.758939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:21.767014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.767543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:21.768580 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:21.769072 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.005724 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-9bdeb934-7790-40c8-8b1a-1aab90f6bbbe req-f138741c-1017-4849-8ab0-08a322eca7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "name": "network-vif-unplugged", "status": "completed", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:22.015804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9bdeb934-7790-40c8-8b1a-1aab90f6bbbe req-f138741c-1017-4849-8ab0-08a322eca7b4 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.017260 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-9bdeb934-7790-40c8-8b1a-1aab90f6bbbe req-f138741c-1017-4849-8ab0-08a322eca7b4 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.036633 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.compute.server_external_events [req-9bdeb934-7790-40c8-8b1a-1aab90f6bbbe req-f138741c-1017-4849-8ab0-08a322eca7b4 service nova] Unable to find a host for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1. Dropping event network-vif-unplugged {{(pid=124277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 21:04:22.037907 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-9bdeb934-7790-40c8-8b1a-1aab90f6bbbe req-f138741c-1017-4849-8ab0-08a322eca7b4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036653 Jul 19 21:04:22.038832 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 452/909] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 21:04:22.173508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:22.296195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-38ef8c16-57e2-4b3e-a59b-1b9389c04229 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.542802 Jul 19 21:04:22.297058 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 458/910] 10.222.0.85 () {62 vars in 1363 bytes} [Tue Jul 19 21:04:21 2022] POST /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-volume_attachments => generated 188 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 21:04:22.429471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:22.430055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:22.437478 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.437933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.438734 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.439214 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.739983 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9923c57a-91c1-4cf3-9bc1-96a7b828da10 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-volume_attachments/0e3a4967-fad1-411c-a69b-57080546e063" status: 202 len: 0 microversion: 2.20 time: 0.315241 Jul 19 21:04:22.741046 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 453/911] 10.222.0.85 () {60 vars in 1456 bytes} [Tue Jul 19 21:04:22 2022] DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-volume_attachments/0e3a4967-fad1-411c-a69b-57080546e063 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:04:22.822293 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:22.823069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:22.831651 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.832147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.833208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.833765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.941646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1e63bed2-4cd7-4dff-9993-7e531040135e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "POST /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/action" status: 202 len: 0 microversion: 2.20 time: 0.123863 Jul 19 21:04:22.943153 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 459/912] 10.222.0.85 () {62 vars in 1318 bytes} [Tue Jul 19 21:04:22 2022] POST /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:04:22.952560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:22.953194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:22.961161 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.962288 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:22.963137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:22.963578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:23.164280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:23.175607 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:23.177743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:23.179522 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6c0964df-78f7-4e4e-a70c-cf0dba8c3082 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1671 microversion: 2.20 time: 0.231406 Jul 19 21:04:23.180700 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 454/913] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:22 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:24.203598 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:24.205157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:24.221238 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:24.221781 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:24.222758 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:24.223411 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:24.440673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:24.455190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:24.456860 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:24.458302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b323c2e3-2e5b-4bd9-b1c1-e364755381d6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1673 microversion: 2.20 time: 0.260581 Jul 19 21:04:24.459092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 460/914] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:24 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1673 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:25.482368 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:25.483124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:25.491112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:25.491565 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:25.492419 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:25.492893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:25.496149 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:25.720409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:25.730279 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:25.731857 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:25.733331 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c4c313dd-c26d-4cd9-9f2b-eb830f51ac6a tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.255050 Jul 19 21:04:25.734086 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 455/915] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:25 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:26.762724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:26.763347 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:26.770980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:26.771742 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:26.772619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:26.773066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:27.019290 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:27.030363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:27.032012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:27.033358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9efb084a-8449-45b3-9190-a05ab279e2f6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.275099 Jul 19 21:04:27.034026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 461/916] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:26 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:28.055490 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:28.056915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:28.064502 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:28.065452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:28.066387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:28.067034 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:28.308280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:28.319961 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:28.322099 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:28.323759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-629e0c04-0bd9-4a14-9cc0-706e3fa73477 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.272297 Jul 19 21:04:28.324709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 456/917] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:28 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:29.367802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:29.368522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:29.376218 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:29.376757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:29.377657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:29.378095 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:29.571585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:29.584124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:29.587469 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:29.589261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b501b5d0-e143-4f99-9f46-997d118df2db tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.225766 Jul 19 21:04:29.590001 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 462/918] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:29 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:30.611147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:30.612194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:30.620486 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:30.621307 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:30.622208 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:30.622727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:30.842437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:30.853802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:30.855693 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:30.857096 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3708b289-24c6-49a6-8f4e-09f67d031f44 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.250259 Jul 19 21:04:30.858001 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 457/919] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:30 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:31.880808 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:31.882199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:31.894130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:31.894855 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:31.896371 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:31.897149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:32.165535 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:32.178072 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:32.179699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:32.181804 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-73521ee7-841d-4ae8-9072-58f7705ef751 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.309125 Jul 19 21:04:32.182404 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 463/920] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:31 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:33.213956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:33.216270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:33.229087 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:33.229988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:33.231553 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:33.232445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:33.440294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:33.452569 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:33.454701 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:33.456448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-99d650fc-50c6-41d3-8557-e3ff14a99c1b tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.250252 Jul 19 21:04:33.457084 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 458/921] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:33 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:34.485159 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:34.486069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:34.493651 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:34.494090 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:34.494917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:34.495354 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:34.745032 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:34.762194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:34.765970 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:34.768352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-cf5ef572-c59d-423a-9893-4218fff24b6f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.291465 Jul 19 21:04:34.769719 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 464/922] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:34 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:35.799501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:35.800148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:35.807400 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:35.807849 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:35.808841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:35.809417 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:35.993832 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:36.002981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:36.004611 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:36.005820 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc13281b-87d9-4e26-9856-144543fdf7b6 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.211609 Jul 19 21:04:36.006389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 459/923] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:35 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:37.032190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:37.033081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:37.041471 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:37.041909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:37.042968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:37.043448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:37.199884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:37.215096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:37.218772 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:37.220910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-11669e7b-61e9-4820-9928-c7455f09fe02 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.192994 Jul 19 21:04:37.221853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 465/924] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:37 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:38.405090 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:38.405889 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:38.413977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:38.414511 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:38.415621 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:38.416258 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:38.519776 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:04:38.519776 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:04:38.589986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:38.599374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:38.600969 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:38.602199 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8ae6ca66-cb7b-4442-ade7-735239bf2737 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.365237 Jul 19 21:04:38.602778 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 460/925] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:38 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:39.622740 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:39.623374 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:39.631026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:39.631477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:39.632269 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:39.632739 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:39.847548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:39.856933 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:39.858528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:39.859778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8d502790-e8f7-443b-95bb-1937ce8fa577 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.241554 Jul 19 21:04:39.860388 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 466/926] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:39 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:40.879608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:40.880455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:40.888753 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:40.889202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:40.889995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:40.890430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:41.060888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:41.076891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:41.079945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:41.082211 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c304c38a-64ae-4330-8010-dbb003995baf tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.206844 Jul 19 21:04:41.083264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 461/927] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:40 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:42.112929 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:42.114247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:42.117564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=36 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:42.125796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:42.126222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:42.127134 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:42.127918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:42.328883 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:42.338818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:42.340466 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:42.341725 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3057dd32-39cd-4733-b524-e8ead32d3f72 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.233741 Jul 19 21:04:42.342298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 467/928] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:42 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:43.361103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:43.361716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:43.364188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=36 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:43.370364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:43.370821 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:43.371674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:43.372141 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:43.520804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:43.531097 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:43.532705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:43.533920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-032a008a-1877-42de-a061-4efbae1eaaa8 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.177392 Jul 19 21:04:43.534500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 462/929] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:43 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:44.554729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:44.555869 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:44.562350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:44.562792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:44.563566 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:44.563995 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:44.741077 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:44.750011 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:44.751959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:44.753222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1343a308-ff82-481f-9185-5f7593324f51 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.203159 Jul 19 21:04:44.753796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 468/930] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:44 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:45.772767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:45.773406 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:45.780629 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:45.781283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:45.782281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:45.782838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:45.973750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:45.983248 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:45.984846 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:45.986117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-94e6ccfa-8314-4528-b6cf-35d009144446 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.217975 Jul 19 21:04:45.987097 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 463/931] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:45 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:47.008780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:47.010050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:47.018422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:47.018878 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:47.020355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:47.020772 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:47.168540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:47.177292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:47.178931 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:47.180177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-520180c5-5628-4a9f-9db0-fc6a166a01d4 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.178442 Jul 19 21:04:47.180894 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 469/932] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:47 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:48.201894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:48.202674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:48.210592 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:48.211191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.212380 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:48.212892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.285128 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-66cecb6e-ff65-49dd-988c-6d1a32d0f6d0 req-e5a37c4d-e1b1-4687-ab96-f1895f0d4f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "name": "network-vif-plugged", "status": "completed", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:48.296179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-66cecb6e-ff65-49dd-988c-6d1a32d0f6d0 req-e5a37c4d-e1b1-4687-ab96-f1895f0d4f7c service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:48.297036 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-66cecb6e-ff65-49dd-988c-6d1a32d0f6d0 req-e5a37c4d-e1b1-4687-ab96-f1895f0d4f7c service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:48.311523 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-66cecb6e-ff65-49dd-988c-6d1a32d0f6d0 req-e5a37c4d-e1b1-4687-ab96-f1895f0d4f7c service nova] Creating event network-vif-plugged:f425b1ee-f44a-45dc-b4ef-247a915d2a5f for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 on hv-cinder-74915 Jul 19 21:04:48.318295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-66cecb6e-ff65-49dd-988c-6d1a32d0f6d0 req-e5a37c4d-e1b1-4687-ab96-f1895f0d4f7c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037949 Jul 19 21:04:48.319518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 470/933] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:04:48.396104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:48.406284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:48.408119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:48.409517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1003e167-2f3d-46e4-8022-82700d16d78d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.212789 Jul 19 21:04:48.410747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 464/934] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:48 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:49.035601 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-160984429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897274336", "security_groups": [{"name": "tempest-secgroup-smoke-1746131802"}], "block_device_mapping_v2": [{"uuid": "db79b6d3-9041-40f2-9600-f1078db2b36b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2a1cb6e-5ef1-4fb9-b7b1-7ad9aeec34c4"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:49.177142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] validate_networks() for [('f2a1cb6e-5ef1-4fb9-b7b1-7ad9aeec34c4', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:04:49.435070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:49.436093 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:49.449338 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:49.450217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:49.451673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:49.452509 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:49.705618 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:49.715351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:49.717132 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:49.718454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9c34ad94-3339-4fcf-858b-65a955de583e tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.291004 Jul 19 21:04:49.719117 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 465/935] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:49 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:49.747329 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:04:49.747920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:04:49.748456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:04:49.749403 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:04:49.749983 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:04:49.762915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:49.763443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:49.764293 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:49.764816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:49.785437 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for project e08c8f78187d474a865ea712616685cc. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:04:49.791023 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Getting quotas for user 5634da4012cc4d468f84409736c28e09 and project e08c8f78187d474a865ea712616685cc. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:04:49.861823 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:04:49.864200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db79b6d3-9041-40f2-9600-f1078db2b36b',volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:04:50.018390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1cb9b9c6-08e0-4172-a2f4-d2dd934136c1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987360 Jul 19 21:04:50.019039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 471/936] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:04:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:04:50.031241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4e6fa577-1539-452c-a12f-f76630627ddb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:50.032013 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4e6fa577-1539-452c-a12f-f76630627ddb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:50.112978 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4e6fa577-1539-452c-a12f-f76630627ddb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:50.126898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4e6fa577-1539-452c-a12f-f76630627ddb tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1093 microversion: 2.1 time: 0.100106 Jul 19 21:04:50.128022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 466/937] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:50 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1093 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:50.749439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:50.751509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:50.763534 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:50.764193 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:50.765939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:50.766422 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:50.951923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:50.968314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:50.971636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:50.974568 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-93f406f3-cc12-4a03-b88c-850b21d3106c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1729 microversion: 2.20 time: 0.232390 Jul 19 21:04:50.975682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 472/938] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:50 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:04:51.155168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:51.156143 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:51.165901 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:51.166359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:51.167211 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:51.167667 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:51.254748 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:51.263881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0f4dc729-289a-4c71-b934-230ae9581e29 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1191 microversion: 2.1 time: 0.114065 Jul 19 21:04:51.264807 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 467/939] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:51 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:51.998786 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:51.999865 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:52.011927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.012674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.013880 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.014615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.283841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:52.284919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:52.295407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.296596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.297864 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:52.298760 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:52.454362 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:52.456853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:52.461784 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:52.464807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:52.466448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:52.467698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-64c47bc5-8490-4f29-ac29-08f4f94a6b22 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1716 microversion: 2.20 time: 0.476507 Jul 19 21:04:52.468279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 473/940] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:04:51 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1716 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:04:52.472562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-60962bcb-1086-47e1-b650-789a7162a948 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1209 microversion: 2.1 time: 0.192824 Jul 19 21:04:52.473989 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 468/941] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:52 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:53.498907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:53.500123 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:53.514917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:53.515767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:53.517674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:53.518554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:53.747375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:53.761596 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2a86f24b-0fd9-4b67-b6a3-018f5ae6cf21 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.271450 Jul 19 21:04:53.762767 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 474/942] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:53 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:53.828843 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-4e1ae468-f945-4522-92a8-e995d759b988 req-3b7d80fc-efa4-4bf2-bc9a-e196b6428b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf93988-50f7-4d26-a03c-116789a37175", "tag": "912ced9e-b0c9-4131-b3a6-a9bded932219"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:04:53.845782 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-4e1ae468-f945-4522-92a8-e995d759b988 req-3b7d80fc-efa4-4bf2-bc9a-e196b6428b8e service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:53.846513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-4e1ae468-f945-4522-92a8-e995d759b988 req-3b7d80fc-efa4-4bf2-bc9a-e196b6428b8e service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:53.867790 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-4e1ae468-f945-4522-92a8-e995d759b988 req-3b7d80fc-efa4-4bf2-bc9a-e196b6428b8e service nova] Creating event network-changed:912ced9e-b0c9-4131-b3a6-a9bded932219 for instance adf93988-50f7-4d26-a03c-116789a37175 on hv-cinder-74915 Jul 19 21:04:53.876757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-4e1ae468-f945-4522-92a8-e995d759b988 req-3b7d80fc-efa4-4bf2-bc9a-e196b6428b8e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051230 Jul 19 21:04:53.877759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 469/943] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:04:54.783574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:54.784478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:54.792756 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:54.793247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:54.794145 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:54.794802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:54.953917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:54.962778 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5fa83194-ce3a-408a-a04f-7b70cf24b359 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.186124 Jul 19 21:04:54.963374 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 475/944] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:54 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:55.982595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:55.983298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:55.990755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:55.991202 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:55.991997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:55.992642 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:55.995555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=80 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:56.192441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:56.202416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0119310a-d0e3-466e-92c9-3c57c4cc2e8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.224680 Jul 19 21:04:56.203384 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 470/945] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:55 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:57.223821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:57.224946 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:57.234287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:57.234738 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:57.235565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:57.236005 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:57.389492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:57.399501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d20f723d-e5d2-4e42-9759-aef0a396dff2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.183141 Jul 19 21:04:57.400104 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 476/946] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:57 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:58.426002 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:58.426913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:58.434432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:58.434957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:58.435770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:58.436216 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:58.597298 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:58.611666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c8b7570b-6f46-4603-8cd2-bbfcfa8de388 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.189649 Jul 19 21:04:58.612763 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 471/947] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:58 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:04:59.630819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:04:59.631418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:04:59.638631 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.639084 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.639875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:04:59.640302 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:04:59.773526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:59.798659 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=6 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:04:59.831264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:04:59.839499 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dafb2026-f63a-4cca-888b-a460281b7c7a tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.212679 Jul 19 21:04:59.840082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 477/948] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:04:59 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:00.864468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:00.865467 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:00.868693 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:00.875938 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:00.876585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:00.877503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:00.878019 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:01.062810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:01.074416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ae4c2ea5-f135-4003-ab06-19973b698453 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.214665 Jul 19 21:05:01.075010 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 472/949] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:00 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:02.091306 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:02.091937 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:02.098711 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:02.099146 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:02.099914 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:02.100352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:02.283461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:02.296666 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5949aca1-0c8b-4bdb-8954-4ba1369afe0e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.209006 Jul 19 21:05:02.297373 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 478/950] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:02 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:03.314948 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:03.315605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:03.324095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:03.324679 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:03.325534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:03.326014 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:03.479945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:03.488750 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fcca10dd-93cc-468e-9457-acc63630cbc2 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.177285 Jul 19 21:05:03.489337 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 473/951] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:03 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:04.506266 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:04.506858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:04.514687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:04.515195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:04.516039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:04.516615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:04.676737 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:04.685449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2f0cc679-26ad-4490-ae3e-9a221e3c9b26 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.182911 Jul 19 21:05:04.685955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 479/952] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:04 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:05.703392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:05.704189 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:05.710985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:05.711430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:05.712259 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:05.712724 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:05.876556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:05.885002 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a16af209-e5e2-46e2-bc1c-d87685f6d6d1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.185360 Jul 19 21:05:05.885756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 474/953] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:05 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:06.368186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-76c6a175-b87d-4d27-a5cc-a89f76e38e7d req-5cef00aa-0758-4a00-ae68-bfef09edd195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf93988-50f7-4d26-a03c-116789a37175", "name": "network-vif-plugged", "status": "completed", "tag": "912ced9e-b0c9-4131-b3a6-a9bded932219"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:06.382530 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-76c6a175-b87d-4d27-a5cc-a89f76e38e7d req-5cef00aa-0758-4a00-ae68-bfef09edd195 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.382808 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-76c6a175-b87d-4d27-a5cc-a89f76e38e7d req-5cef00aa-0758-4a00-ae68-bfef09edd195 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:06.396796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-76c6a175-b87d-4d27-a5cc-a89f76e38e7d req-5cef00aa-0758-4a00-ae68-bfef09edd195 service nova] Creating event network-vif-plugged:912ced9e-b0c9-4131-b3a6-a9bded932219 for instance adf93988-50f7-4d26-a03c-116789a37175 on hv-cinder-74915 Jul 19 21:05:06.403794 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-76c6a175-b87d-4d27-a5cc-a89f76e38e7d req-5cef00aa-0758-4a00-ae68-bfef09edd195 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040877 Jul 19 21:05:06.404916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 480/954] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:06.903364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:06.903998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:06.911784 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.912305 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:06.913125 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:06.913608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:07.089590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:07.099529 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7a7e6e82-1763-4a89-9a14-ba658d18a986 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.200161 Jul 19 21:05:07.100106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 475/955] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:06 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:08.119578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:08.120917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:08.128410 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:08.129406 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:08.130311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:08.130793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:08.303203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:08.311769 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9bd5e3b5-2979-4d74-beb0-a8319763dc8f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1265 microversion: 2.1 time: 0.197536 Jul 19 21:05:08.312426 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 481/956] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:08 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:09.330571 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:09.331230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:09.338359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.338797 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.339576 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.340009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.496405 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:09.505549 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dbc22031-cd12-4a38-9bdf-e79de7646d95 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1449 microversion: 2.1 time: 0.178981 Jul 19 21:05:09.506148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 476/957] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:09 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:05:09.527261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:09.528436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:09.540369 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.541161 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.542549 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:09.543352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:09.722232 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:09.730743 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8b490eb3-ee94-4f70-94c6-9142c4272e44 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1449 microversion: 2.1 time: 0.211745 Jul 19 21:05:09.731331 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 482/958] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:09 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1449 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:12.075484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-4bd2e0b4-f8cf-4da9-8163-91f86e9e9571 req-e8ff3c45-02e6-4b9c-9e53-af0c46563294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf93988-50f7-4d26-a03c-116789a37175", "tag": "912ced9e-b0c9-4131-b3a6-a9bded932219"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:12.092207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-4bd2e0b4-f8cf-4da9-8163-91f86e9e9571 req-e8ff3c45-02e6-4b9c-9e53-af0c46563294 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:12.093102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-4bd2e0b4-f8cf-4da9-8163-91f86e9e9571 req-e8ff3c45-02e6-4b9c-9e53-af0c46563294 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:12.108351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-4bd2e0b4-f8cf-4da9-8163-91f86e9e9571 req-e8ff3c45-02e6-4b9c-9e53-af0c46563294 service nova] Creating event network-changed:912ced9e-b0c9-4131-b3a6-a9bded932219 for instance adf93988-50f7-4d26-a03c-116789a37175 on hv-cinder-74915 Jul 19 21:05:12.114210 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-4bd2e0b4-f8cf-4da9-8163-91f86e9e9571 req-e8ff3c45-02e6-4b9c-9e53-af0c46563294 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043795 Jul 19 21:05:12.115177 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 477/959] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:46.856580 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:46.857629 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=51 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:46.964027 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:46.964627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:46.971895 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:46.972380 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:46.973196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:46.973632 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:47.000955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-da71aef9-c07d-4c6d-aaaf-d3f808956e5d tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/ips" status: 200 len: 150 microversion: 2.1 time: 0.150273 Jul 19 21:05:47.001502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 483/960] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 21:05:46 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/ips => generated 150 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:48.376360 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=33 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:48.377147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=43 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:05:48.382348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d2b6630-1d73-4b7f-9309-48212de2caf5"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:05:48.383601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:48.391392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:48.391840 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:48.392686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:48.393123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:48.700261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ceed9df2-00ee-4858-b9bd-392bfb83f63c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "POST /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325654 Jul 19 21:05:48.701120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 478/961] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:05:48 2022] POST /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:05:56.430987 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:56.431903 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:56.439320 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:56.439686 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:56.441003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:56.441433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:56.537686 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'services' on Instance uuid dc42ba5e-a57c-421b-aae9-1c6919d63e78 {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:05:56.635816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-641d10cc-24e7-4d1e-a964-eb0fbf45936e tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments/5d2b6630-1d73-4b7f-9309-48212de2caf5" status: 202 len: 0 microversion: 2.1 time: 0.208238 Jul 19 21:05:56.637205 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 484/962] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:05:56 2022] DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments/5d2b6630-1d73-4b7f-9309-48212de2caf5 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:05:56.654960 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:56.657824 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:56.671035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:56.672521 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:56.673418 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:56.673868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:56.711538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-20725f22-5373-4882-b127-e65867e82096 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066235 Jul 19 21:05:56.712290 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 479/963] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:56 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:05:57.727314 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:57.728739 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:57.736565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:57.737527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:57.738351 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:57.738792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:57.777500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f716a1e5-211f-4269-bb2b-dc04581b296a tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056818 Jul 19 21:05:57.778109 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 485/964] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:05:57 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:05:57.853966 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:57.854668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:57.862098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:57.862604 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:57.863455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:57.863962 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:57.898310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:05:58.008243 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-95fc736e-9de4-4581-87a0-242dc47c4481 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 204 len: 0 microversion: 2.1 time: 0.158138 Jul 19 21:05:58.008927 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 480/965] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:05:57 2022] DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:05:58.021068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:58.021881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:58.029477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:58.030128 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:58.031052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:58.031547 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:58.200169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:58.215141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3a38f272-3418-49ce-b4cc-6f48fc6360a2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1681 microversion: 2.1 time: 0.199680 Jul 19 21:05:58.216198 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 486/966] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:58 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:59.243610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:59.244647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:59.252191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.253168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.254008 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.254533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.411876 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:05:59.420268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fb68e1ae-77d6-4ba9-addf-7b24db81db63 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1681 microversion: 2.1 time: 0.181049 Jul 19 21:05:59.420892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 481/967] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:05:59 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:59.637300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:59.638300 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:59.646491 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.646917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.647809 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.648257 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.683671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8996a91f-0cad-4a17-ae19-bad790b6b4fe tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051103 Jul 19 21:05:59.684669 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 487/968] 10.222.0.85 () {60 vars in 1342 bytes} [Tue Jul 19 21:05:59 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:05:59.751314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:59.751810 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:59.759487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.759919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.760740 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.761172 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.791217 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:05:59.881672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8c61e1d2-59f5-45a7-8af3-fc4bf3da3e08 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 204 len: 0 microversion: 2.20 time: 0.134087 Jul 19 21:05:59.882141 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 482/969] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jul 19 21:05:59 2022] DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 21:05:59.892516 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:05:59.893224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:05:59.899897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.900457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:05:59.901267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:05:59.901704 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:00.082325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:00.092144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:00.093747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:00.095009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-12377d37-df90-4b06-ac07-81787058366c tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.206688 Jul 19 21:06:00.095576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 488/970] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:05:59 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 21:06:00.439950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:00.441250 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:00.448472 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:00.448950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:00.449735 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:00.450169 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:00.603139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:00.611249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a53437f2-73d7-4ad3-8e12-f22468980f3c tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1681 microversion: 2.1 time: 0.175969 Jul 19 21:06:00.612390 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 483/971] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:00 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:06:01.115946 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:01.116918 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:01.124128 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:01.124646 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:01.125499 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:01.125977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:01.288116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:01.297273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:01.298813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:01.300618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d3a56b43-e051-4332-b8d9-df5da55f3678 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.189885 Jul 19 21:06:01.301216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 489/972] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:06:01 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:06:01.634806 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:01.636014 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:01.648870 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:01.649674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:01.651115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:01.651903 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:01.948111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:01.957696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4f5f4047-0c28-46fc-a464-c279782cf386 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1681 microversion: 2.1 time: 0.330212 Jul 19 21:06:01.958581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 484/973] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:01 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:02.325982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:02.327183 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:02.340067 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:02.340914 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:02.342624 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:02.343651 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:02.733530 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-6ec4daab-97cf-49e0-a04e-ecc8bba047ff req-c2f8213d-5c5a-4da9-801d-e57c17c304c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc42ba5e-a57c-421b-aae9-1c6919d63e78", "name": "network-vif-deleted", "tag": "b80c726a-c011-4a23-986f-05bbbb3bcbda"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:02.751270 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:02.775168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6ec4daab-97cf-49e0-a04e-ecc8bba047ff req-c2f8213d-5c5a-4da9-801d-e57c17c304c6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:02.784005 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-6ec4daab-97cf-49e0-a04e-ecc8bba047ff req-c2f8213d-5c5a-4da9-801d-e57c17c304c6 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:02.812661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-6ec4daab-97cf-49e0-a04e-ecc8bba047ff req-c2f8213d-5c5a-4da9-801d-e57c17c304c6 service nova] Creating event network-vif-deleted:b80c726a-c011-4a23-986f-05bbbb3bcbda for instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 on hv-cinder-74915 Jul 19 21:06:02.823102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-6ec4daab-97cf-49e0-a04e-ecc8bba047ff req-c2f8213d-5c5a-4da9-801d-e57c17c304c6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095431 Jul 19 21:06:02.824124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 485/974] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:06:02.831792 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:02.844495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:02.853031 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dd711e62-9ded-4e6b-b030-dc22b9c4cbff tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1722 microversion: 2.20 time: 0.532966 Jul 19 21:06:02.868892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 490/975] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:06:02 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:06:02.980194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:02.982013 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:02.994300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:02.995484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:02.997320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:02.998181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.048770 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.049472 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.050233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lazy-loading 'fault' on Instance uuid dc42ba5e-a57c-421b-aae9-1c6919d63e78 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:06:03.124043 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4c6ceff33ee449193fe6d4f7b2c01ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2f1232dd344ca7a48bf3fbc36dfb39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:03.142852 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-170fa527-244d-4d54-95cf-1c2d464e42a6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 200 len: 1330 microversion: 2.1 time: 0.169736 Jul 19 21:06:03.145680 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 486/976] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:02 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 1330 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:03.175576 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-41c141b9-55d0-4ccc-98fa-d29e07764bef req-6c3b06a4-f31f-4dac-b3ff-ab7c07454570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7bb733-32bd-48a4-9c5d-771b2c658ad1", "name": "network-vif-deleted", "tag": "f425b1ee-f44a-45dc-b4ef-247a915d2a5f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:03.187132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-41c141b9-55d0-4ccc-98fa-d29e07764bef req-6c3b06a4-f31f-4dac-b3ff-ab7c07454570 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.188289 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-41c141b9-55d0-4ccc-98fa-d29e07764bef req-6c3b06a4-f31f-4dac-b3ff-ab7c07454570 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.210915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-41c141b9-55d0-4ccc-98fa-d29e07764bef req-6c3b06a4-f31f-4dac-b3ff-ab7c07454570 service nova] Creating event network-vif-deleted:f425b1ee-f44a-45dc-b4ef-247a915d2a5f for instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 on hv-cinder-74915 Jul 19 21:06:03.219420 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-41c141b9-55d0-4ccc-98fa-d29e07764bef req-6c3b06a4-f31f-4dac-b3ff-ab7c07454570 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046813 Jul 19 21:06:03.223702 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 491/977] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:06:03.887876 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:03.889038 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:03.901712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.902841 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.904453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.905662 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.973861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:03.974497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:03.975588 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lazy-loading 'fault' on Instance uuid bb7bb733-32bd-48a4-9c5d-771b2c658ad1 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:06:04.050382 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:04.064756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:04.070350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f026e791bf24a9fab1aaedb794e6229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9432177a8ce4a4abec0ac6e372ce681', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:04.073061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d740b4eb-cfe4-4306-a297-844271fe1c09 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 200 len: 1371 microversion: 2.20 time: 0.192354 Jul 19 21:06:04.085533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 487/978] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:06:03 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 21:06:04.164941 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:04.165689 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:04.173769 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:04.175098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:04.175934 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:04.176408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:04.202944 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 HTTP/1.1 Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:04.206836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:04.209717 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'dc42ba5e-a57c-421b-aae9-1c6919d63e78'} Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:04.211264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:04.215450 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:04.222207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:04.222207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6f1a5038-23fc-4a76-80b9-6635c7c5e5d2 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 404 len: 111 microversion: 2.1 time: 0.060272 Jul 19 21:06:04.224639 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 492/979] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:04 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:04.237956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bf6499ce-fa7c-4f28-a2a2-1b29987b27bf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '.version_select at 0x7f125f3ee430>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:04.276762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bf6499ce-fa7c-4f28-a2a2-1b29987b27bf tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897443553" status: 202 len: 0 microversion: 2.1 time: 0.045932 Jul 19 21:06:04.278064 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 488/980] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jul 19 21:06:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897443553 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:06:05.096926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:05.098019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:05.107643 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:05.108412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:05.109773 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:05.110505 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:05.135121 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] HTTP exception thrown: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Request method failure captured: Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 HTTP/1.1 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoNpZwlRBZK-yaWeKAGNAWgJ8QEKard1NQYBwKqfhM5THiiPSEtjvPnMOggrfA35Rm_oWoDzsd6I0Y9_OhhD4nGtPkEJ7uyrbSrptwQKDkLZ0aFkaAu8rWPzvQBJeXvN_d6UZWBdjY72nhKeVCfz6BKnrwwGjrSiEowPAP5Jbfu--A Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:05.138075 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 1f026e791bf24a9fab1aaedb794e6229 Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:05.139642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'bb7bb733-32bd-48a4-9c5d-771b2c658ad1'} Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:05.140525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:05.141920 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:05.143707 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Returning 404 to user: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:05.143707 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b5cac15c-21e3-4f44-b72d-d4cfe6041004 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 404 len: 111 microversion: 2.20 time: 0.050725 Jul 19 21:06:05.143707 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 493/981] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:06:05 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:06:05.157500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f00c1e1f-e826-4e52-bee5-3dcac24580dc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '.version_select at 0x7f1267da7430>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:05.188155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f00c1e1f-e826-4e52-bee5-3dcac24580dc tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342986633" status: 204 len: 0 microversion: 2.20 time: 0.038327 Jul 19 21:06:05.189249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 489/982] 10.222.0.85 () {60 vars in 1261 bytes} [Tue Jul 19 21:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1342986633 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 21:06:06.692972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:06.693578 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:06.701220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.701665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.702455 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.702890 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.722064 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 HTTP/1.1 Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:06.723713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.726112 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'dc42ba5e-a57c-421b-aae9-1c6919d63e78'} Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:06.727511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.729955 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.732417 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:06.732417 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-968d641a-6e19-4803-abb0-a1d285177886 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 404 len: 111 microversion: 2.1 time: 0.037042 Jul 19 21:06:06.732417 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 494/983] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:06:06 2022] DELETE /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:06.737323 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:06.738004 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: dc42ba5e-a57c-421b-aae9-1c6919d63e78] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:06.745310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.745952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.747188 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:06.747879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:06.765058 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 HTTP/1.1 Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:06:06.766847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.770137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'dc42ba5e-a57c-421b-aae9-1c6919d63e78'} Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:06.771183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. Jul 19 21:06:06.772709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:06.774747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance dc42ba5e-a57c-421b-aae9-1c6919d63e78 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:06.774747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bb912ac2-0590-4ce5-8178-c038db2d6b34 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78" status: 404 len: 111 microversion: 2.1 time: 0.035879 Jul 19 21:06:06.774747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 490/984] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:06 2022] GET /compute/v2.1/servers/dc42ba5e-a57c-421b-aae9-1c6919d63e78 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:07.228176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.228761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:07.236478 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.236981 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.237843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.238571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.258151 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] HTTP exception thrown: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Request method failure captured: Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 HTTP/1.1 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoNpZwlRBZK-yaWeKAGNAWgJ8QEKard1NQYBwKqfhM5THiiPSEtjvPnMOggrfA35Rm_oWoDzsd6I0Y9_OhhD4nGtPkEJ7uyrbSrptwQKDkLZ0aFkaAu8rWPzvQBJeXvN_d6UZWBdjY72nhKeVCfz6BKnrwwGjrSiEowPAP5Jbfu--A Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:07.259852 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 1f026e791bf24a9fab1aaedb794e6229 Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.263736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'bb7bb733-32bd-48a4-9c5d-771b2c658ad1'} Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:07.265366 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.269556 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.273182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Returning 404 to user: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:07.273182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c7969823-e44a-4a71-a6b4-a73cc2e8ab36 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 404 len: 111 microversion: 2.20 time: 0.039251 Jul 19 21:06:07.273182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 495/985] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jul 19 21:06:07 2022] DELETE /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:06:07.278499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.279372 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: bb7bb733-32bd-48a4-9c5d-771b2c658ad1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:07.287137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.287632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.288776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.289517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.316499 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] HTTP exception thrown: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Request method failure captured: Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 HTTP/1.1 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoNpZwlRBZK-yaWeKAGNAWgJ8QEKard1NQYBwKqfhM5THiiPSEtjvPnMOggrfA35Rm_oWoDzsd6I0Y9_OhhD4nGtPkEJ7uyrbSrptwQKDkLZ0aFkaAu8rWPzvQBJeXvN_d6UZWBdjY72nhKeVCfz6BKnrwwGjrSiEowPAP5Jbfu--A Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:06:07.318181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 1f026e791bf24a9fab1aaedb794e6229 Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.320862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'bb7bb733-32bd-48a4-9c5d-771b2c658ad1'} Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:07.321980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. Jul 19 21:06:07.323636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.325062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Returning 404 to user: Instance bb7bb733-32bd-48a4-9c5d-771b2c658ad1 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:07.325062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-64862179-592c-4ced-aa1d-a44a6b69254f tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1" status: 404 len: 111 microversion: 2.20 time: 0.049098 Jul 19 21:06:07.325062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 491/986] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:06:07 2022] GET /compute/v2.1/servers/bb7bb733-32bd-48a4-9c5d-771b2c658ad1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:06:07.940118 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.941664 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:07.953996 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.954554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.955698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:07.956485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:07.973726 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd HTTP/1.1 Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:07.975432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:07.978480 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '4bcd3d43-1700-4062-b83f-6a1851ae44bd'} Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:07.980156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:07.982988 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:07.985503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:07.985503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-310a58cd-2013-4739-acfb-6ebe0d6492cc tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 404 len: 111 microversion: 2.1 time: 0.044446 Jul 19 21:06:07.985503 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 496/987] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:06:07 2022] DELETE /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:07.990868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:07.991518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 4bcd3d43-1700-4062-b83f-6a1851ae44bd] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:08.001253 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.001707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.003126 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.003585 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.019704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd HTTP/1.1 Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:06:08.021320 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:08.023719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '4bcd3d43-1700-4062-b83f-6a1851ae44bd'} Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:08.025098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. Jul 19 21:06:08.026934 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.029409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 4bcd3d43-1700-4062-b83f-6a1851ae44bd could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:08.029409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c0283c1b-d8cc-4610-86d0-063ae535e2fe tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd" status: 404 len: 111 microversion: 2.1 time: 0.038640 Jul 19 21:06:08.029409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 492/988] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:07 2022] GET /compute/v2.1/servers/4bcd3d43-1700-4062-b83f-6a1851ae44bd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:08.033618 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:08.034198 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:08.041446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.041899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.042693 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.043131 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.059500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 HTTP/1.1 Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:08.061141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.063487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '1e084f98-237c-4483-b3e7-67e1dda82279'} Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:08.064835 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.067315 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.070298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:08.070298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6b8033d4-a133-43ca-ad2a-d63c388931f6 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 404 len: 111 microversion: 2.1 time: 0.034250 Jul 19 21:06:08.070298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 497/989] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:06:08 2022] DELETE /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:08.073791 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:08.074327 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 1e084f98-237c-4483-b3e7-67e1dda82279] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:08.081433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.081936 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.082845 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.083327 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.099876 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 HTTP/1.1 Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:06:08.101813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '1e084f98-237c-4483-b3e7-67e1dda82279'} Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:08.105555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. Jul 19 21:06:08.107830 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.109919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 1e084f98-237c-4483-b3e7-67e1dda82279 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:08.109919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1bb1f7af-3103-499a-97d8-db8c905a88f8 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279" status: 404 len: 111 microversion: 2.1 time: 0.035685 Jul 19 21:06:08.109919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 493/990] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:08 2022] GET /compute/v2.1/servers/1e084f98-237c-4483-b3e7-67e1dda82279 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:08.490897 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:08.491396 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:08.498396 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.498843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.499817 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.500275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.515917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] HTTP exception thrown: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Request method failure captured: Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 HTTP/1.1 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoNpZwlRBZK-yaWeKAGNAWgJ8QEKard1NQYBwKqfhM5THiiPSEtjvPnMOggrfA35Rm_oWoDzsd6I0Y9_OhhD4nGtPkEJ7uyrbSrptwQKDkLZ0aFkaAu8rWPzvQBJeXvN_d6UZWBdjY72nhKeVCfz6BKnrwwGjrSiEowPAP5Jbfu--A Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:08.517581 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 1f026e791bf24a9fab1aaedb794e6229 Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.520679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '318211d6-3f74-4f53-bfd8-0a10d7272b05'} Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:08.522227 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.524681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.527004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Returning 404 to user: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:08.527004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-47dc0b5d-a02f-4a65-8c8c-d231ec54eb3d tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 404 len: 111 microversion: 2.20 time: 0.033207 Jul 19 21:06:08.527004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 498/991] 10.222.0.85 () {60 vars in 1279 bytes} [Tue Jul 19 21:06:08 2022] DELETE /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:06:08.530920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:08.531914 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] [instance: 318211d6-3f74-4f53-bfd8-0a10d7272b05] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:08.539236 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.539692 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.540541 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:08.540995 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:08.557431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] HTTP exception thrown: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Request method failure captured: Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 HTTP/1.1 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoNpZwlRBZK-yaWeKAGNAWgJ8QEKard1NQYBwKqfhM5THiiPSEtjvPnMOggrfA35Rm_oWoDzsd6I0Y9_OhhD4nGtPkEJ7uyrbSrptwQKDkLZ0aFkaAu8rWPzvQBJeXvN_d6UZWBdjY72nhKeVCfz6BKnrwwGjrSiEowPAP5Jbfu--A Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:06:08.559051 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c9432177a8ce4a4abec0ac6e372ce681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: c9432177a8ce4a4abec0ac6e372ce681 Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-902346745 Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 1f026e791bf24a9fab1aaedb794e6229 Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-902346745-project Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.561858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '318211d6-3f74-4f53-bfd8-0a10d7272b05'} Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:08.563247 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. Jul 19 21:06:08.565212 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:08.567292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] Returning 404 to user: Instance 318211d6-3f74-4f53-bfd8-0a10d7272b05 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:08.567292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1370a654-49d4-4b7b-9713-ec7456444911 tempest-AttachVolumeShelveTestJSON-902346745 tempest-AttachVolumeShelveTestJSON-902346745-project] 10.222.0.85 "GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05" status: 404 len: 111 microversion: 2.20 time: 0.034729 Jul 19 21:06:08.567292 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 494/992] 10.222.0.85 () {60 vars in 1276 bytes} [Tue Jul 19 21:06:08 2022] GET /compute/v2.1/servers/318211d6-3f74-4f53-bfd8-0a10d7272b05 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 21:06:09.276710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:09.277589 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:09.286489 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.287184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:09.288735 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.289477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:09.306028 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 HTTP/1.1 Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:06:09.307637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.310298 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '5aef110a-35e6-4bad-8ec1-279639b358c4'} Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:09.311165 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.313485 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.317926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:09.317926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a23af9e4-3178-449f-867e-258efc3e0c51 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 404 len: 111 microversion: 2.1 time: 0.037472 Jul 19 21:06:09.317926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 499/993] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:06:09 2022] DELETE /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:06:09.323786 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:09.325180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] [instance: 5aef110a-35e6-4bad-8ec1-279639b358c4] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:09.337455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.338246 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:09.339673 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:09.340489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:09.349515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:09.365319 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] HTTP exception thrown: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Request method failure captured: Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 HTTP/1.1 Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xoGfulprA3KZK_0QthbKX-V2YwUClXk6ujNi4XOKwIFjwGOLt12aJ0CBHUhePv0T9qSZMrlreWJ-qs5Vy2ey2M4cMPr4xWTcvEcs0CYluwQCDFO929ZVcSJ26afDe_BCOowWaH8hzjkqi9xteASI_ANYKPeZfAYvPCzBaKodtZtaXA Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:06:09.367892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_0c2f1232dd344ca7a48bf3fbc36dfb39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 0c2f1232dd344ca7a48bf3fbc36dfb39 Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-100612636 Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: d4c6ceff33ee449193fe6d4f7b2c01ec Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeNegativeTest-100612636-project Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.370475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '5aef110a-35e6-4bad-8ec1-279639b358c4'} Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:06:09.371885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. Jul 19 21:06:09.376045 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:06:09.379834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] Returning 404 to user: Instance 5aef110a-35e6-4bad-8ec1-279639b358c4 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:06:09.379834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-105b560b-51c8-490c-9268-5412e4c93a71 tempest-AttachVolumeNegativeTest-100612636 tempest-AttachVolumeNegativeTest-100612636-project] 10.222.0.85 "GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4" status: 404 len: 111 microversion: 2.1 time: 0.054714 Jul 19 21:06:09.379834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 495/994] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:09 2022] GET /compute/v2.1/servers/5aef110a-35e6-4bad-8ec1-279639b358c4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:06:21.881587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=34 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:21.882759 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:22.107716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1a3c3f19-126e-4c19-b396-7383c4f3b82d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: .version_select at 0x7f125f3dbd30>, body: {"keypair": {"name": "tempest-keypair-264335920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAmnwhPlEndyrKTl6JLvoP+8r6rQPg/aIf2p9DQyIjRVETv95FJIUH2xUKhEuNjb+evJLLHg0ZIS5IyzrfHj6IE1H/z/6wMDIqmLi5RUvNPXern4ocJSdfLE8Nijpk4hQ=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:22.124519 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-1a3c3f19-126e-4c19-b396-7383c4f3b82d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:06:22.133074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-1a3c3f19-126e-4c19-b396-7383c4f3b82d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for user 187add5855314ff5b802b74297a6e7b0 and project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:06:22.185586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1a3c3f19-126e-4c19-b396-7383c4f3b82d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.308144 Jul 19 21:06:22.185586 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 500/995] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 21:06:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:23.955896 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-444989437", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbc738d-9672-4a71-90ac-816b2d7db1a9"}], "security_groups": [{"name": "tempest-securitygroup--2083423926"}], "key_name": "tempest-keypair-264335920", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:23.974425 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:24.176376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] validate_networks() for [('1fbc738d-9672-4a71-90ac-816b2d7db1a9', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:06:24.957366 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:06:24.958448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:06:24.958952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:06:24.959680 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:06:24.960783 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:06:24.981207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:24.982456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:24.984300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:24.985433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:25.029481 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:06:25.037977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for user 187add5855314ff5b802b74297a6e7b0 and project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:06:25.061105 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:06:25.066900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:06:25.154448 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-06901d05-48ca-4947-9329-a4e3b36aa89d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.208059 Jul 19 21:06:25.156237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 496/996] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:06:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:06:25.176222 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-af1f92cd-18ca-4c5d-9da4-71fde21e01f1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:25.177452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-af1f92cd-18ca-4c5d-9da4-71fde21e01f1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:25.333807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-af1f92cd-18ca-4c5d-9da4-71fde21e01f1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:25.356376 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-af1f92cd-18ca-4c5d-9da4-71fde21e01f1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1236 microversion: 2.1 time: 0.189675 Jul 19 21:06:25.357728 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 501/997] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:25 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1236 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:26.388239 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:26.390620 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:26.407060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:26.407060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:26.407060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:26.407887 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:26.550455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:26.567142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cd0fd2bd-a263-4a39-8226-3e23be6948db tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1232 microversion: 2.1 time: 0.185408 Jul 19 21:06:26.581191 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 497/998] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:26 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1232 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:27.596657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:27.597429 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:27.604631 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:27.605224 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:27.606066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:27.606509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:27.731981 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:27.746360 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c741af73-55e2-4f47-96cd-4084850e9748 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1296 microversion: 2.1 time: 0.153744 Jul 19 21:06:27.748133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 502/999] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:27 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1296 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:28.771610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:28.772838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:28.789554 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:28.790311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:28.792737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:28.794331 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:29.019888 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:29.044883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bbb76816-4095-42c4-9e7b-f2ccd6a12072 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.281257 Jul 19 21:06:29.052540 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 498/1000] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:28 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:29.929623 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-a18aa5a8-394b-49e0-a3ca-5e7acaf781c0 req-c7215564-117c-4077-aba4-d9932bfa8f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c20534-0f18-4ec7-b2c9-017e359ea7d5", "tag": "4a8444d8-c8fc-4d26-baed-0a1ea1ec734c"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:29.966208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a18aa5a8-394b-49e0-a3ca-5e7acaf781c0 req-c7215564-117c-4077-aba4-d9932bfa8f1e service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:29.967063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-a18aa5a8-394b-49e0-a3ca-5e7acaf781c0 req-c7215564-117c-4077-aba4-d9932bfa8f1e service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:29.983255 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-a18aa5a8-394b-49e0-a3ca-5e7acaf781c0 req-c7215564-117c-4077-aba4-d9932bfa8f1e service nova] Creating event network-changed:4a8444d8-c8fc-4d26-baed-0a1ea1ec734c for instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 on hv-cinder-74915 Jul 19 21:06:29.992845 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-a18aa5a8-394b-49e0-a3ca-5e7acaf781c0 req-c7215564-117c-4077-aba4-d9932bfa8f1e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073303 Jul 19 21:06:29.994264 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 503/1001] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:06:30.083622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:30.085281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:30.100758 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:30.102650 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:30.104120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:30.105169 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:30.518718 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:30.529139 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2f27d3cd-1665-41fe-9610-e0eef30dec24 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.465435 Jul 19 21:06:30.530265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 499/1002] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:30 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:31.560553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:31.561875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:31.577189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:31.578001 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:31.579495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:31.580438 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:31.835141 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:31.853283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f28e81aa-6a6d-4010-a3c5-1aead91bb76d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.301868 Jul 19 21:06:31.854346 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 504/1003] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:31 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:32.883409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:32.884737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:32.896959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:32.897789 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:32.899271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:32.900168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:33.100961 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:33.111947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-49f7391d-0444-404d-90f3-fc12d7ea5f68 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.235952 Jul 19 21:06:33.112940 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 500/1004] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:32 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:34.135494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:34.136710 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:34.145960 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:34.146560 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:34.147546 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:34.148091 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:34.358247 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:34.368959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0e7bf571-ef3d-4cdf-bdfe-10f711e1ad3f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.240746 Jul 19 21:06:34.369806 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 505/1005] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:34 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:35.393474 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:35.395797 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:35.401254 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:35.402487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=6 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:35.414910 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:35.415751 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:35.417270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:35.418062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:35.667306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:35.683760 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bbc8a701-6ef6-405d-b9aa-6b55c7b928b4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.298252 Jul 19 21:06:35.684837 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 501/1006] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:35 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:36.711200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:36.711977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:36.714917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=6 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:06:36.725939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:36.726753 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:36.728613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:36.729388 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:36.909446 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:36.918164 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9a763925-7a9d-4995-ad02-9508c36fdb9e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.212122 Jul 19 21:06:36.918842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 506/1007] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:36 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:37.449013 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-d52af8f1-1576-42d4-9976-a52e94d6cf67 req-cf867925-6328-40ff-8e17-939658d76f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c20534-0f18-4ec7-b2c9-017e359ea7d5", "name": "network-vif-plugged", "status": "completed", "tag": "4a8444d8-c8fc-4d26-baed-0a1ea1ec734c"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:37.458386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-d52af8f1-1576-42d4-9976-a52e94d6cf67 req-cf867925-6328-40ff-8e17-939658d76f90 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:37.458853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-d52af8f1-1576-42d4-9976-a52e94d6cf67 req-cf867925-6328-40ff-8e17-939658d76f90 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:37.471776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-d52af8f1-1576-42d4-9976-a52e94d6cf67 req-cf867925-6328-40ff-8e17-939658d76f90 service nova] Creating event network-vif-plugged:4a8444d8-c8fc-4d26-baed-0a1ea1ec734c for instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 on hv-cinder-74915 Jul 19 21:06:37.477694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-d52af8f1-1576-42d4-9976-a52e94d6cf67 req-cf867925-6328-40ff-8e17-939658d76f90 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225970 Jul 19 21:06:37.478315 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 502/1008] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:06:37.950706 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:37.952658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:37.960442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:37.960791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:37.962026 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:37.962616 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:38.145525 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:38.154913 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ebd78be1-a019-44a7-9884-673c5142943b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.210574 Jul 19 21:06:38.155802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 507/1009] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:37 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:39.175649 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:39.176902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:39.186094 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:39.186768 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:39.187708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:39.188270 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:39.366374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:39.375512 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eb618951-8128-45ac-9129-3446f2b27426 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1362 microversion: 2.1 time: 0.205610 Jul 19 21:06:39.376172 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 503/1010] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:39 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:40.396620 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:40.397496 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:40.405497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.406046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:40.406930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.407435 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:40.611749 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:06:40.627199 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8d215fb5-f687-44b9-93f8-ebc4cb3b86b9 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1548 microversion: 2.1 time: 0.235044 Jul 19 21:06:40.628256 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 508/1011] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:06:40 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:06:40.648151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:06:40.649070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:06:40.657894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.659049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:40.660437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:40.660950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:40.786518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-310f828c-b20a-41a6-ad33-b014552d1878 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143046 Jul 19 21:06:40.787446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 504/1012] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 21:06:40 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:06:42.506940 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-b745a162-5b11-4498-b119-fac648c66c87 req-f900d5e8-9a26-4e46-a56f-7568db1b9b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c20534-0f18-4ec7-b2c9-017e359ea7d5", "tag": "4a8444d8-c8fc-4d26-baed-0a1ea1ec734c"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:06:42.520470 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-b745a162-5b11-4498-b119-fac648c66c87 req-f900d5e8-9a26-4e46-a56f-7568db1b9b72 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:06:42.521069 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-b745a162-5b11-4498-b119-fac648c66c87 req-f900d5e8-9a26-4e46-a56f-7568db1b9b72 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:06:42.539672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-b745a162-5b11-4498-b119-fac648c66c87 req-f900d5e8-9a26-4e46-a56f-7568db1b9b72 service nova] Creating event network-changed:4a8444d8-c8fc-4d26-baed-0a1ea1ec734c for instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 on hv-cinder-74915 Jul 19 21:06:42.549817 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-b745a162-5b11-4498-b119-fac648c66c87 req-f900d5e8-9a26-4e46-a56f-7568db1b9b72 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135232 Jul 19 21:06:42.550938 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 509/1013] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:07.544806 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:07.545931 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=40 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:07.548462 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:07.549269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:07.551445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-419dcade-7f49-4103-81a8-6bc344d396f0 req-acb85d63-542d-453b-9979-823c0ceb1391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf93988-50f7-4d26-a03c-116789a37175", "tag": "912ced9e-b0c9-4131-b3a6-a9bded932219"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:07.554006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:07.554958 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=44 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:07.562926 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-419dcade-7f49-4103-81a8-6bc344d396f0 req-acb85d63-542d-453b-9979-823c0ceb1391 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:07.563524 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-419dcade-7f49-4103-81a8-6bc344d396f0 req-acb85d63-542d-453b-9979-823c0ceb1391 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:07.577028 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:07.578072 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:07.578448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-419dcade-7f49-4103-81a8-6bc344d396f0 req-acb85d63-542d-453b-9979-823c0ceb1391 service nova] Creating event network-changed:912ced9e-b0c9-4131-b3a6-a9bded932219 for instance adf93988-50f7-4d26-a03c-116789a37175 on hv-cinder-74915 Jul 19 21:07:07.579902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:07.580817 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:07.586049 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-419dcade-7f49-4103-81a8-6bc344d396f0 req-acb85d63-542d-453b-9979-823c0ceb1391 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042386 Jul 19 21:07:07.587154 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 510/1014] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:07.831274 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:07:07.944308 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-541ad680-1a5e-4060-91f4-571f356bc0ce tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "DELETE /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 204 len: 0 microversion: 2.1 time: 0.400880 Jul 19 21:07:07.946022 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 505/1015] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:07:07 2022] DELETE /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 21:07:07.960602 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:07.962047 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:07.972653 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:07.973358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:07.974261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:07.974719 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:08.171400 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:08.180780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ee924f0e-567a-4d1c-87fa-119cdb105598 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1573 microversion: 2.1 time: 0.227986 Jul 19 21:07:08.181555 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 511/1016] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:07 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1573 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:09.209203 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:09.210435 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:09.222665 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:09.223275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:09.224262 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:09.225033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:09.426163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:09.435205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-daf692db-d492-4443-8484-df97d25647b1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1573 microversion: 2.1 time: 0.234213 Jul 19 21:07:09.436036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 506/1017] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:09 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:10.455028 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:10.455928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:10.462934 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:10.463377 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:10.464160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:10.464625 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:10.696587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:10.711250 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f6843b0d-2c0c-4db6-b173-9728189d042f tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1573 microversion: 2.1 time: 0.260689 Jul 19 21:07:10.729353 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 512/1018] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:10 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1573 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:11.743518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:11.744566 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:11.756140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:11.757069 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:11.758435 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:11.759245 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:12.113762 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:12.130405 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9e8ef535-fecb-402a-af24-3a5eb2f1d567 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 200 len: 1455 microversion: 2.1 time: 0.394161 Jul 19 21:07:12.144365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 507/1019] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:11 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 1455 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:12.382734 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-8ef998b4-6a0f-4e15-953c-428a7304cf09 req-4d6416e4-b7bf-4da7-ab09-ecb4cc1a5c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf93988-50f7-4d26-a03c-116789a37175", "name": "network-vif-deleted", "tag": "912ced9e-b0c9-4131-b3a6-a9bded932219"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:12.399936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8ef998b4-6a0f-4e15-953c-428a7304cf09 req-4d6416e4-b7bf-4da7-ab09-ecb4cc1a5c73 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:12.399936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-8ef998b4-6a0f-4e15-953c-428a7304cf09 req-4d6416e4-b7bf-4da7-ab09-ecb4cc1a5c73 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:12.434202 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-8ef998b4-6a0f-4e15-953c-428a7304cf09 req-4d6416e4-b7bf-4da7-ab09-ecb4cc1a5c73 service nova] Creating event network-vif-deleted:912ced9e-b0c9-4131-b3a6-a9bded932219 for instance adf93988-50f7-4d26-a03c-116789a37175 on hv-cinder-74915 Jul 19 21:07:12.448831 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-8ef998b4-6a0f-4e15-953c-428a7304cf09 req-4d6416e4-b7bf-4da7-ab09-ecb4cc1a5c73 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.363425 Jul 19 21:07:12.453548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 513/1020] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:07:13.159645 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:13.160616 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: adf93988-50f7-4d26-a03c-116789a37175] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:13.170497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:13.170844 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:13.171637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:13.172073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:13.191771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] HTTP exception thrown: Instance adf93988-50f7-4d26-a03c-116789a37175 could not be found. Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Request method failure captured: Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 HTTP/1.1 Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xrf9Veh_GHQOKZ0qT0n1EXsqe3nJCL9yEvO1VKrFmwzFJM3_F13Haa2TAGf4WVoooEMAgOt5wJj6H5ag9pcL6H-oTHmxnGn8VnQQZ9ekDCNCLrmzR6Nc0zLUgAYDaWaaPlO_PHPNPBIB2Lw1OhWXvHnC89XZuvE5jO4etw__TbiJPM Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:07:13.193518 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08c8f78187d474a865ea712616685cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08c8f78187d474a865ea712616685cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 5634da4012cc4d468f84409736c28e09 Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance adf93988-50f7-4d26-a03c-116789a37175 could not be found. Jul 19 21:07:13.196600 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'adf93988-50f7-4d26-a03c-116789a37175'} Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf93988-50f7-4d26-a03c-116789a37175 could not be found. Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:07:13.198430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf93988-50f7-4d26-a03c-116789a37175 could not be found. Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf93988-50f7-4d26-a03c-116789a37175 could not be found. Jul 19 21:07:13.201314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:13.203497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Returning 404 to user: Instance adf93988-50f7-4d26-a03c-116789a37175 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:07:13.203497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-16f11325-4911-44df-8344-a7a28a57bc1e tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175" status: 404 len: 111 microversion: 2.1 time: 0.041195 Jul 19 21:07:13.203497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 508/1021] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:13 2022] GET /compute/v2.1/servers/adf93988-50f7-4d26-a03c-116789a37175 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:07:21.376868 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:21.377910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:21.381321 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-40a45f75-9098-44f2-b04e-1ab708cb85b8 req-13eec452-3193-4929-af34-f154d9bae943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c127c65-a754-40a2-ad08-ae0ce383d3f1", "tag": "c560ed26-06c1-4b1a-b002-d91cd631f59c"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:21.387512 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:21.388523 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:21.391094 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:21.393116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:21.403503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-40a45f75-9098-44f2-b04e-1ab708cb85b8 req-13eec452-3193-4929-af34-f154d9bae943 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:21.404010 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-40a45f75-9098-44f2-b04e-1ab708cb85b8 req-13eec452-3193-4929-af34-f154d9bae943 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:21.418396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-40a45f75-9098-44f2-b04e-1ab708cb85b8 req-13eec452-3193-4929-af34-f154d9bae943 service nova] Creating event network-changed:c560ed26-06c1-4b1a-b002-d91cd631f59c for instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 on hv-cinder-74915 Jul 19 21:07:21.425211 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-40a45f75-9098-44f2-b04e-1ab708cb85b8 req-13eec452-3193-4929-af34-f154d9bae943 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050623 Jul 19 21:07:21.426681 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 509/1022] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:21.450179 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:07:21.607351 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d4355066-a00d-456c-ad40-cc22e68044e4 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "DELETE /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 204 len: 0 microversion: 2.1 time: 0.236532 Jul 19 21:07:21.610466 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 514/1023] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:07:21 2022] DELETE /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:07:21.622675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:21.623931 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:21.635487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:21.636553 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:21.637906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:21.638799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:22.031526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:22.041587 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d85ac9ed-1ca7-44a5-beb5-8f06f2b9a58b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1576 microversion: 2.1 time: 0.426573 Jul 19 21:07:22.042364 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 510/1024] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:21 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1576 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:07:23.069052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:23.070168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:23.078669 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:23.079250 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:23.080107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:23.080592 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:23.375565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:23.386959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-db283e1e-7780-481c-b9a7-3f17a66a80a1 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1576 microversion: 2.1 time: 0.323739 Jul 19 21:07:23.392398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 515/1025] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:23 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1576 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:24.068382 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-ed89b3b3-89f1-46a2-92f6-cc4e7ec2bd9a req-f3903878-47f1-4d23-b23f-0633ff82e5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c127c65-a754-40a2-ad08-ae0ce383d3f1", "name": "network-vif-deleted", "tag": "c560ed26-06c1-4b1a-b002-d91cd631f59c"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:07:24.085756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ed89b3b3-89f1-46a2-92f6-cc4e7ec2bd9a req-f3903878-47f1-4d23-b23f-0633ff82e5dc service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:24.086596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-ed89b3b3-89f1-46a2-92f6-cc4e7ec2bd9a req-f3903878-47f1-4d23-b23f-0633ff82e5dc service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:24.108242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-ed89b3b3-89f1-46a2-92f6-cc4e7ec2bd9a req-f3903878-47f1-4d23-b23f-0633ff82e5dc service nova] Creating event network-vif-deleted:c560ed26-06c1-4b1a-b002-d91cd631f59c for instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 on hv-cinder-74915 Jul 19 21:07:24.116421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-ed89b3b3-89f1-46a2-92f6-cc4e7ec2bd9a req-f3903878-47f1-4d23-b23f-0633ff82e5dc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057400 Jul 19 21:07:24.117781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 511/1026] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:07:24.419309 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:24.421632 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:24.437295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:24.438790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:24.440915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:24.442528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:24.581881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5634da4012cc4d468f84409736c28e09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08c8f78187d474a865ea712616685cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:07:24.601507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-585885bd-7934-43b8-bc98-32f2fd08c722 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 200 len: 1225 microversion: 2.1 time: 0.188425 Jul 19 21:07:24.603610 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 516/1027] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:24 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:07:25.630379 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:25.631804 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 7c127c65-a754-40a2-ad08-ae0ce383d3f1] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:25.644880 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:25.646634 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:25.648500 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:25.649299 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:25.681350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] HTTP exception thrown: Instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 could not be found. Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Request method failure captured: Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 HTTP/1.1 Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xrf9Veh_GHQOKZ0qT0n1EXsqe3nJCL9yEvO1VKrFmwzFJM3_F13Haa2TAGf4WVoooEMAgOt5wJj6H5ag9pcL6H-oTHmxnGn8VnQQZ9ekDCNCLrmzR6Nc0zLUgAYDaWaaPlO_PHPNPBIB2Lw1OhWXvHnC89XZuvE5jO4etw__TbiJPM Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:07:25.684743 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08c8f78187d474a865ea712616685cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08c8f78187d474a865ea712616685cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 5634da4012cc4d468f84409736c28e09 Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 could not be found. Jul 19 21:07:25.686176 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '7c127c65-a754-40a2-ad08-ae0ce383d3f1'} Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 could not be found. Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:07:25.687127 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 could not be found. Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 could not be found. Jul 19 21:07:25.688551 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:25.689906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Returning 404 to user: Instance 7c127c65-a754-40a2-ad08-ae0ce383d3f1 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:07:25.689906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d59500b6-dbc3-4506-86a8-cebd45c9c1e3 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1" status: 404 len: 111 microversion: 2.1 time: 0.067580 Jul 19 21:07:25.693902 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 512/1028] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:25 2022] GET /compute/v2.1/servers/7c127c65-a754-40a2-ad08-ae0ce383d3f1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:07:26.515265 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:26.518032 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:26.528982 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:26.529777 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:26.531211 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:26.532025 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:26.553783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] HTTP exception thrown: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Request method failure captured: Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: DELETE /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 HTTP/1.1 Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xrf9Veh_GHQOKZ0qT0n1EXsqe3nJCL9yEvO1VKrFmwzFJM3_F13Haa2TAGf4WVoooEMAgOt5wJj6H5ag9pcL6H-oTHmxnGn8VnQQZ9ekDCNCLrmzR6Nc0zLUgAYDaWaaPlO_PHPNPBIB2Lw1OhWXvHnC89XZuvE5jO4etw__TbiJPM Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:07:26.556637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08c8f78187d474a865ea712616685cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08c8f78187d474a865ea712616685cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 5634da4012cc4d468f84409736c28e09 Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.558442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '13be579c-9ae8-4e74-9d8f-5dd6d6202c42'} Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:07:26.559780 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.561281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.562630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Returning 404 to user: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:07:26.562630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f8f9bd40-70c3-46be-85cd-13d4166da975 tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "DELETE /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 404 len: 111 microversion: 2.1 time: 0.050589 Jul 19 21:07:26.562630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 517/1029] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:07:26 2022] DELETE /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:07:26.574111 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:26.575271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] [instance: 13be579c-9ae8-4e74-9d8f-5dd6d6202c42] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:07:26.586980 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:26.587777 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:26.589246 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:07:26.590279 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:07:26.614637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] HTTP exception thrown: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Request method failure captured: Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 HTTP/1.1 Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xrf9Veh_GHQOKZ0qT0n1EXsqe3nJCL9yEvO1VKrFmwzFJM3_F13Haa2TAGf4WVoooEMAgOt5wJj6H5ag9pcL6H-oTHmxnGn8VnQQZ9ekDCNCLrmzR6Nc0zLUgAYDaWaaPlO_PHPNPBIB2Lw1OhWXvHnC89XZuvE5jO4etw__TbiJPM Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:07:26.617593 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e08c8f78187d474a865ea712616685cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e08c8f78187d474a865ea712616685cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e08c8f78187d474a865ea712616685cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: e08c8f78187d474a865ea712616685cc Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-TestVolumeBootPattern-1036747286 Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 5634da4012cc4d468f84409736c28e09 Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-TestVolumeBootPattern-1036747286-project Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.619920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '13be579c-9ae8-4e74-9d8f-5dd6d6202c42'} Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:07:26.620847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. Jul 19 21:07:26.622526 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:07:26.623986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Returning 404 to user: Instance 13be579c-9ae8-4e74-9d8f-5dd6d6202c42 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:07:26.623986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c89f6cdf-10c7-4c0c-b0f7-09dbd57c414b tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42" status: 404 len: 111 microversion: 2.1 time: 0.053779 Jul 19 21:07:26.623986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 513/1030] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:07:26 2022] GET /compute/v2.1/servers/13be579c-9ae8-4e74-9d8f-5dd6d6202c42 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:07:28.127461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-63ade55d-ac34-4056-97b3-0f41c34eff1d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] Calling method '.version_select at 0x7f125f47d310>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:07:28.180083 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-63ade55d-ac34-4056-97b3-0f41c34eff1d tempest-TestVolumeBootPattern-1036747286 tempest-TestVolumeBootPattern-1036747286-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897274336" status: 202 len: 0 microversion: 2.1 time: 0.060986 Jul 19 21:07:28.201434 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 518/1031] 10.222.0.85 () {58 vars in 1259 bytes} [Tue Jul 19 21:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897274336 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:08:04.378863 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-91f24e31-59d2-4fd1-956b-c1bc73a4d7e6 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Action: 'create', calling method: .version_select at 0x7f125f3ee280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-490122489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPQtAk8Ff55FBxzxCZV5j0JyfN+1NKO26RHdu8MZkhQXAsCETSJdjR87hMTryOlfUn9mSm1/yc0ZDY5LbagbnG8pfV91DQGODSAkg2s2hNbM+LBUdPshp5DJujv4cknnA=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:04.386577 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:04.387662 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:04.413241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-91f24e31-59d2-4fd1-956b-c1bc73a4d7e6 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Getting quotas for project 41ea12b35ccb471284d0bfde7d24089b. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:08:04.419464 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-91f24e31-59d2-4fd1-956b-c1bc73a4d7e6 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Getting quotas for user f649ce79152d4d23866dde7dbe067ea1 and project 41ea12b35ccb471284d0bfde7d24089b. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:08:04.448040 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-91f24e31-59d2-4fd1-956b-c1bc73a4d7e6 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.077007 Jul 19 21:08:04.448705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 514/1032] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 21:08:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:04.506507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:04.507567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:04.513200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1625645989", "imageRef": "1fc9535d-853f-4971-a925-2ce90b657466", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-490122489", "networks": [{"uuid": "e2e619ea-e804-45fd-b34c-5d095af000c2"}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:04.571984 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] validate_networks() for [('e2e619ea-e804-45fd-b34c-5d095af000c2', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:08:05.180374 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:08:05.181138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:08:05.181962 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:08:05.182699 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:08:05.183449 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:08:05.198911 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:05.199585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:05.200878 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:05.201522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:05.237434 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Getting quotas for project 41ea12b35ccb471284d0bfde7d24089b. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:08:05.245379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Getting quotas for user f649ce79152d4d23866dde7dbe067ea1 and project 41ea12b35ccb471284d0bfde7d24089b. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:08:05.261447 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:08:05.263716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1fc9535d-853f-4971-a925-2ce90b657466',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:08:05.326706 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [33c5deb2-167a-41d6-acbb-96d5a690a5de] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:08:06.339333 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [33c5deb2-167a-41d6-acbb-96d5a690a5de] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 60980. Jul 19 21:08:06.346379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fe9fe2bd-3670-40b7-8f0a-f74a703cd66b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.840966 Jul 19 21:08:06.347510 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 519/1033] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 21:08:06.365050 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3e902b8d-df30-4c37-915b-5771a0e3b4f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:06.365972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3e902b8d-df30-4c37-915b-5771a0e3b4f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:06.440996 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3e902b8d-df30-4c37-915b-5771a0e3b4f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:06.449012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3e902b8d-df30-4c37-915b-5771a0e3b4f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.091650 Jul 19 21:08:06.449618 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 515/1034] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:06 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:07.474122 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5c010c96-96a9-45e8-aec0-8f953265a1d2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:07.475258 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5c010c96-96a9-45e8-aec0-8f953265a1d2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:07.574467 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5c010c96-96a9-45e8-aec0-8f953265a1d2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:07.588203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5c010c96-96a9-45e8-aec0-8f953265a1d2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.122402 Jul 19 21:08:07.589274 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 520/1035] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:07 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:08.613494 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ff81d5a4-7804-4e03-9d64-1d217bb35f61 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:08.614152 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ff81d5a4-7804-4e03-9d64-1d217bb35f61 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:08.673444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ff81d5a4-7804-4e03-9d64-1d217bb35f61 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:08.686140 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ff81d5a4-7804-4e03-9d64-1d217bb35f61 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.076598 Jul 19 21:08:08.687207 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 516/1036] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:08 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:09.711978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1d1983d2-944c-4c5d-97d4-c35e6e366159 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:09.713071 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1d1983d2-944c-4c5d-97d4-c35e6e366159 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:09.800569 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1d1983d2-944c-4c5d-97d4-c35e6e366159 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:09.808630 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1d1983d2-944c-4c5d-97d4-c35e6e366159 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.104019 Jul 19 21:08:09.809228 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 521/1037] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:09 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:10.829556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0aee5fd3-d43c-41d7-b8b5-312f5b7c8606 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:10.830487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0aee5fd3-d43c-41d7-b8b5-312f5b7c8606 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:10.898199 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0aee5fd3-d43c-41d7-b8b5-312f5b7c8606 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:10.906016 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0aee5fd3-d43c-41d7-b8b5-312f5b7c8606 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.082772 Jul 19 21:08:10.907123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 517/1038] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:10 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:11.935828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4f71c9a8-6b35-42a8-92cc-5f2e2f352050 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:11.936968 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4f71c9a8-6b35-42a8-92cc-5f2e2f352050 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:12.038279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4f71c9a8-6b35-42a8-92cc-5f2e2f352050 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:12.047737 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4f71c9a8-6b35-42a8-92cc-5f2e2f352050 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.117265 Jul 19 21:08:12.048492 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 522/1039] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:11 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:13.072610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0e9a4c35-095a-4ebe-b8d6-dea59155d0c4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:13.073796 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0e9a4c35-095a-4ebe-b8d6-dea59155d0c4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:13.165471 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0e9a4c35-095a-4ebe-b8d6-dea59155d0c4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:13.173947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0e9a4c35-095a-4ebe-b8d6-dea59155d0c4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.109223 Jul 19 21:08:13.174987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 518/1040] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:13 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:14.200095 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-db5fd90d-7513-4f3d-979a-171eff5a37f1 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:14.201137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-db5fd90d-7513-4f3d-979a-171eff5a37f1 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:14.270233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-db5fd90d-7513-4f3d-979a-171eff5a37f1 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:14.282174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-db5fd90d-7513-4f3d-979a-171eff5a37f1 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.083950 Jul 19 21:08:14.282174 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 523/1041] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:14 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:15.300374 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a3a1c19c-3a1c-4f5c-9952-6662c6a7a350 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:15.301350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a3a1c19c-3a1c-4f5c-9952-6662c6a7a350 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:15.379407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a3a1c19c-3a1c-4f5c-9952-6662c6a7a350 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:15.389334 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a3a1c19c-3a1c-4f5c-9952-6662c6a7a350 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.092875 Jul 19 21:08:15.390060 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 519/1042] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:15 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:15.828963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:15.829892 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:15.831483 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:15.832146 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:15.840171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:15.840731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:15.841583 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:15.842066 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:15.873385 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ca557394-4fff-480e-841f-466cf2071bdb tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/ips" status: 200 len: 146 microversion: 2.1 time: 0.049063 Jul 19 21:08:15.873979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 524/1043] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 21:08:15 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:16.409787 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ecb9616f-63f1-4dd2-9a5b-df69f8b94138 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:16.410651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ecb9616f-63f1-4dd2-9a5b-df69f8b94138 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:16.488737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ecb9616f-63f1-4dd2-9a5b-df69f8b94138 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:16.497241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ecb9616f-63f1-4dd2-9a5b-df69f8b94138 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.092591 Jul 19 21:08:16.498145 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 520/1044] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:16 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:17.518917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d82efe21-c3ed-400c-a65a-e27ad962743b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:17.519765 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d82efe21-c3ed-400c-a65a-e27ad962743b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:17.603061 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d82efe21-c3ed-400c-a65a-e27ad962743b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:17.610733 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d82efe21-c3ed-400c-a65a-e27ad962743b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.097650 Jul 19 21:08:17.611325 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 525/1045] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:17 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:18.036263 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f5ee2c1-3443-4c8f-b35a-e25b0f9409cb"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:18.038122 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:18.047737 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:18.048534 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:18.049982 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:18.050556 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:18.433716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a4a47caa-fab4-47e6-8a09-4bacedcfbb12 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402669 Jul 19 21:08:18.434449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 521/1046] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:08:18 2022] POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:08:18.631665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-62bc0aa2-c43d-4ebf-9c3c-1cc3dc442691 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:18.632963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-62bc0aa2-c43d-4ebf-9c3c-1cc3dc442691 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:18.715925 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-62bc0aa2-c43d-4ebf-9c3c-1cc3dc442691 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:18.728957 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-62bc0aa2-c43d-4ebf-9c3c-1cc3dc442691 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.103742 Jul 19 21:08:18.730345 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 526/1047] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:18 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:19.755539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-35e10173-b33e-40c8-8c8c-5847dc3db027 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:19.756470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-35e10173-b33e-40c8-8c8c-5847dc3db027 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:19.827233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-35e10173-b33e-40c8-8c8c-5847dc3db027 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:19.842729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-35e10173-b33e-40c8-8c8c-5847dc3db027 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.095499 Jul 19 21:08:19.843813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 522/1048] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:19 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:20.871775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-79d03ebd-4ca3-4039-a62e-1e264400a2f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:20.872676 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-79d03ebd-4ca3-4039-a62e-1e264400a2f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:20.937822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-79d03ebd-4ca3-4039-a62e-1e264400a2f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:20.945246 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-79d03ebd-4ca3-4039-a62e-1e264400a2f2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.078345 Jul 19 21:08:20.946087 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 527/1049] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:20 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:21.963859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4f8f5b05-15d7-4f57-8dd5-8004be9b55b9 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:21.964789 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4f8f5b05-15d7-4f57-8dd5-8004be9b55b9 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:22.043759 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4f8f5b05-15d7-4f57-8dd5-8004be9b55b9 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:22.054598 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4f8f5b05-15d7-4f57-8dd5-8004be9b55b9 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.094487 Jul 19 21:08:22.055627 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 523/1050] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:21 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:23.073217 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3fbba918-9b28-4bbc-9aa0-c3d5eec57c1c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:23.073820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3fbba918-9b28-4bbc-9aa0-c3d5eec57c1c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:23.144985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3fbba918-9b28-4bbc-9aa0-c3d5eec57c1c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:23.153233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3fbba918-9b28-4bbc-9aa0-c3d5eec57c1c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.084401 Jul 19 21:08:23.153803 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 528/1051] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:23 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:24.172858 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b1e44870-54ba-4f15-88ca-4acf503884b0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:24.173686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b1e44870-54ba-4f15-88ca-4acf503884b0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:24.249617 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b1e44870-54ba-4f15-88ca-4acf503884b0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:24.262547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b1e44870-54ba-4f15-88ca-4acf503884b0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.094526 Jul 19 21:08:24.263626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 524/1052] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:24 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:25.288837 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ebf4b9ee-184c-4e2c-99ff-3841b09eb40d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:25.289773 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ebf4b9ee-184c-4e2c-99ff-3841b09eb40d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:25.371509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ebf4b9ee-184c-4e2c-99ff-3841b09eb40d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:25.381943 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ebf4b9ee-184c-4e2c-99ff-3841b09eb40d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.098772 Jul 19 21:08:25.382858 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 529/1053] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:25 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:26.163312 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d8f0949a-ee7f-4712-bab9-381dda269e73 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:26.173879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8f0949a-ee7f-4712-bab9-381dda269e73 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:26.174325 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d8f0949a-ee7f-4712-bab9-381dda269e73 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:26.241555 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d8f0949a-ee7f-4712-bab9-381dda269e73 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Going to try to stop instance {{(pid=124277) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 21:08:26.315200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d8f0949a-ee7f-4712-bab9-381dda269e73 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.158691 Jul 19 21:08:26.316919 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 525/1054] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:08:26 2022] POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:08:26.327355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:26.328160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:26.330408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=4 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:26.337790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:26.338240 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:26.339279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:26.339853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:26.402637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0051fb31-a937-4e5f-b429-a476d5315c2d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:26.403371 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0051fb31-a937-4e5f-b429-a476d5315c2d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:26.479351 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0051fb31-a937-4e5f-b429-a476d5315c2d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:26.490494 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0051fb31-a937-4e5f-b429-a476d5315c2d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.092515 Jul 19 21:08:26.491314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 526/1055] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:26 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:26.527048 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:26.542233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9b0f688d-5b74-4369-bb7b-4eccc979e0ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.218776 Jul 19 21:08:26.543308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 530/1056] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:26 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:27.513376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-690219e2-916f-4e77-916a-b9285d894735 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:27.514345 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-690219e2-916f-4e77-916a-b9285d894735 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:27.577082 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:27.578791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:27.590740 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:27.598935 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-690219e2-916f-4e77-916a-b9285d894735 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:27.599169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:27.599169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:27.599169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:27.600532 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-690219e2-916f-4e77-916a-b9285d894735 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.094112 Jul 19 21:08:27.601606 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 527/1057] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:27 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:27.807575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:27.818974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-da8aec91-00f6-467d-9a76-c3f2954aa55a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.249061 Jul 19 21:08:27.820088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 531/1058] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:27 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:28.625144 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-50e15c8b-fb94-4e0b-b1c9-4e262a1a6038 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:28.626080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-50e15c8b-fb94-4e0b-b1c9-4e262a1a6038 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:28.689401 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-50e15c8b-fb94-4e0b-b1c9-4e262a1a6038 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:28.699610 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-50e15c8b-fb94-4e0b-b1c9-4e262a1a6038 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.078769 Jul 19 21:08:28.700353 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 528/1059] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:28 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:28.842879 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:28.843796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:28.851387 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:28.851881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:28.853182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:28.853919 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:29.019433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:29.031817 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0de4d201-8691-4132-aaca-a7d2699bae72 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.192075 Jul 19 21:08:29.032522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 532/1060] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:28 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:29.721654 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cd13ff13-fe4a-40b6-8b20-4f92e7e77499 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:29.722408 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cd13ff13-fe4a-40b6-8b20-4f92e7e77499 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:29.789456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cd13ff13-fe4a-40b6-8b20-4f92e7e77499 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:29.797755 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cd13ff13-fe4a-40b6-8b20-4f92e7e77499 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.081032 Jul 19 21:08:29.798449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 529/1061] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:29 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:30.051515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:30.052176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:30.059308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:30.059731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:30.060560 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:30.061186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:30.303296 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:30.318615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-bfc8e309-5a10-41d2-85ad-721fc4ba4224 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.270830 Jul 19 21:08:30.319685 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 533/1062] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:30 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:30.819595 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-553408ff-0329-4787-aeba-31c371d584c5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:30.820752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-553408ff-0329-4787-aeba-31c371d584c5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:30.887400 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-553408ff-0329-4787-aeba-31c371d584c5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:30.895894 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-553408ff-0329-4787-aeba-31c371d584c5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.081293 Jul 19 21:08:30.897036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 530/1063] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:30 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:31.340171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:31.341086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:31.348636 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:31.349085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:31.349883 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:31.350318 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:31.594301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:31.605200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7833f5cc-c6c0-4eb1-bf0f-4ad007980b7c tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.269654 Jul 19 21:08:31.606014 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 534/1064] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:31 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:31.916671 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-59335754-32a1-468b-98c1-eec2d9d9c490 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:31.917874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-59335754-32a1-468b-98c1-eec2d9d9c490 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:31.980359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-59335754-32a1-468b-98c1-eec2d9d9c490 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:31.988370 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-59335754-32a1-468b-98c1-eec2d9d9c490 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.077091 Jul 19 21:08:31.988981 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 531/1065] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:31 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:32.630875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:32.631532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:32.640625 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:32.641081 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:32.641873 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:32.642311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:32.883186 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:32.893340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2798954d-535b-4660-bd8a-97c6b85fac77 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.268071 Jul 19 21:08:32.894015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 535/1066] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:32 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:33.009456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6e979413-7710-481e-9d05-14c8b4a2c03b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:33.010377 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6e979413-7710-481e-9d05-14c8b4a2c03b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:33.073021 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6e979413-7710-481e-9d05-14c8b4a2c03b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:33.081065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6e979413-7710-481e-9d05-14c8b4a2c03b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.077689 Jul 19 21:08:33.081669 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 532/1067] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:33 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:33.912609 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:33.913475 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:33.920811 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:33.921768 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:33.922567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:33.923006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:34.076909 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:34.090840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f47c745b-367a-4e21-918b-917edfb32a58 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.182261 Jul 19 21:08:34.091793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 536/1068] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:33 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:34.104017 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9135c524-62f3-41aa-a9fc-1afcef0bbc5d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:34.105095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9135c524-62f3-41aa-a9fc-1afcef0bbc5d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:34.168055 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9135c524-62f3-41aa-a9fc-1afcef0bbc5d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:34.181705 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9135c524-62f3-41aa-a9fc-1afcef0bbc5d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.082219 Jul 19 21:08:34.182693 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 533/1069] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:34 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:35.116886 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:35.117760 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:35.119930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:35.126253 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:35.126756 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:35.127574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:35.128004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:35.207752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-30709d3a-ae77-48ca-8d62-e275bf44b455 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:35.209129 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-30709d3a-ae77-48ca-8d62-e275bf44b455 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:35.213073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:35.306106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-30709d3a-ae77-48ca-8d62-e275bf44b455 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:35.310146 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=39 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:35.321230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-30709d3a-ae77-48ca-8d62-e275bf44b455 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.120502 Jul 19 21:08:35.322233 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 534/1070] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:35 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:35.339089 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:35.351819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0c371197-0d5c-4943-ae52-9264b92b92d7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.239220 Jul 19 21:08:35.352983 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 537/1071] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:35 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:36.345932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2974a0ce-0587-40da-91eb-18c4c4d33a93 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:36.346715 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2974a0ce-0587-40da-91eb-18c4c4d33a93 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:36.350065 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:36.379364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:36.380233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:36.386194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=24 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:36.390690 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:36.391164 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:36.391956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:36.392425 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:36.445106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2974a0ce-0587-40da-91eb-18c4c4d33a93 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:36.457954 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2974a0ce-0587-40da-91eb-18c4c4d33a93 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.117406 Jul 19 21:08:36.459238 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 535/1072] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:36 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:36.583323 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:36.597148 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d057c349-68b7-4ff1-ae08-0b3967462ce8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.225176 Jul 19 21:08:36.597830 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 538/1073] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:36 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:37.488059 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5e37e322-5445-443b-92c5-a8afcf9cf773 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:37.488814 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5e37e322-5445-443b-92c5-a8afcf9cf773 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:37.559414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5e37e322-5445-443b-92c5-a8afcf9cf773 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:37.568537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5e37e322-5445-443b-92c5-a8afcf9cf773 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.084861 Jul 19 21:08:37.569485 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 536/1074] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:37 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:37.618002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:37.619051 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:37.630602 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:37.631418 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:37.632901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:37.633713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:37.810180 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:37.820311 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9d4b39d2-e647-4ce7-9c72-37771b153883 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.208619 Jul 19 21:08:37.821267 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 539/1075] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:37 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:38.587431 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a930da0b-10a9-4267-b0f6-e7e0751af06d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:38.588113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a930da0b-10a9-4267-b0f6-e7e0751af06d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:38.649930 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a930da0b-10a9-4267-b0f6-e7e0751af06d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:38.657827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a930da0b-10a9-4267-b0f6-e7e0751af06d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.074250 Jul 19 21:08:38.658416 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 537/1076] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:38 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:38.849213 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:38.850149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:38.857454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:38.857940 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:38.858871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:38.859340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:39.048409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:39.058542 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-1595107c-3636-44b2-b049-1781cba32cd8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.214429 Jul 19 21:08:39.059132 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 540/1077] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:38 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:39.676043 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c907c7e4-e35f-423b-8354-bcdf92a89ec2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:39.676727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c907c7e4-e35f-423b-8354-bcdf92a89ec2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:39.734678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c907c7e4-e35f-423b-8354-bcdf92a89ec2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:39.743056 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c907c7e4-e35f-423b-8354-bcdf92a89ec2 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.071054 Jul 19 21:08:39.743643 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 538/1078] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:39 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:40.078307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:40.079292 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:40.086490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:40.086935 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:40.087713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:40.088156 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:40.261784 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:40.273238 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6f4149ed-e646-43e1-b214-5b9a4cd57511 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.199301 Jul 19 21:08:40.273898 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 541/1079] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:40 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:40.761225 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b4143fa3-2722-438a-abe4-1711679b33d3 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:40.761912 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b4143fa3-2722-438a-abe4-1711679b33d3 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:40.817674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b4143fa3-2722-438a-abe4-1711679b33d3 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:40.825029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b4143fa3-2722-438a-abe4-1711679b33d3 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.067578 Jul 19 21:08:40.825609 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 539/1080] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:40 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:41.291517 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:41.292180 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:41.299745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.300248 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.301085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:41.301523 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:41.477812 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:41.490640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-e1630dfb-1b58-404d-ab8f-1bea7dcc42d6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1723 microversion: 2.1 time: 0.202916 Jul 19 21:08:41.491368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 542/1081] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:41 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:41.843493 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-74e7b0c3-efe5-4efb-907f-bb801c543174 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:41.844396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-74e7b0c3-efe5-4efb-907f-bb801c543174 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:41.925630 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-74e7b0c3-efe5-4efb-907f-bb801c543174 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:41.936601 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-74e7b0c3-efe5-4efb-907f-bb801c543174 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.097296 Jul 19 21:08:41.937279 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 540/1082] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:41 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:42.509007 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:42.509833 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:42.517355 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.517805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.518605 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.519044 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.676845 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:42.685653 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-507df227-a90b-49ee-80c1-abd6a47a0a2e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1700 microversion: 2.1 time: 0.180920 Jul 19 21:08:42.686232 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 543/1083] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:42 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:42.702890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-502a7671-28b3-4a6f-b921-1e25619221c4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:08:42.710213 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-502a7671-28b3-4a6f-b921-1e25619221c4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.710625 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-502a7671-28b3-4a6f-b921-1e25619221c4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.737400 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-502a7671-28b3-4a6f-b921-1e25619221c4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Going to try to start instance {{(pid=124277) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 21:08:42.786612 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-502a7671-28b3-4a6f-b921-1e25619221c4 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.087518 Jul 19 21:08:42.787605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 541/1084] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:08:42 2022] POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:08:42.796495 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:42.797317 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:42.804390 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.804797 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.805593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:42.806207 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:42.963861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-67992687-744a-49a5-be5e-12b4128f96af tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:42.964982 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-67992687-744a-49a5-be5e-12b4128f96af tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:42.998188 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:43.013921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-316bd4e5-f282-4710-b036-12786a75d5f6 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1709 microversion: 2.1 time: 0.221031 Jul 19 21:08:43.015194 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 544/1085] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:42 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1709 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:43.053496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-67992687-744a-49a5-be5e-12b4128f96af tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:43.061429 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-67992687-744a-49a5-be5e-12b4128f96af tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.105860 Jul 19 21:08:43.062594 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 542/1086] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:42 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:44.045844 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:44.046959 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:44.060813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:44.062107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:44.063518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:44.064313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:44.084983 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c858dc0a-0d65-41e5-9dbf-5b1ea33848fa tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:44.086108 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c858dc0a-0d65-41e5-9dbf-5b1ea33848fa tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:44.220445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c858dc0a-0d65-41e5-9dbf-5b1ea33848fa tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:44.228414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c858dc0a-0d65-41e5-9dbf-5b1ea33848fa tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.151489 Jul 19 21:08:44.229326 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 543/1087] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:44 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:44.291133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:44.299724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3bb2c93b-e579-42b5-ac4c-5fd0a4ca4278 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1709 microversion: 2.1 time: 0.263563 Jul 19 21:08:44.300223 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 545/1088] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:44 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:45.254862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f92d496-02dd-4284-9a33-33d888f313ab tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:45.255498 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f92d496-02dd-4284-9a33-33d888f313ab tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:45.315451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8f92d496-02dd-4284-9a33-33d888f313ab tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:45.323798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f92d496-02dd-4284-9a33-33d888f313ab tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.072737 Jul 19 21:08:45.324965 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 544/1089] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:45 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:45.331244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:45.332358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:45.344281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:45.345107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:45.346508 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:08:45.347548 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:08:45.386553 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=100 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:45.526392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:45.535810 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dba2e048-27da-4692-9338-f87bfd159c4d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1713 microversion: 2.1 time: 0.212731 Jul 19 21:08:45.536612 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 546/1090] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:45 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1713 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:46.342712 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cf8048ac-3c28-4ea2-b865-cd988447b36b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:46.344081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cf8048ac-3c28-4ea2-b865-cd988447b36b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:46.403309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cf8048ac-3c28-4ea2-b865-cd988447b36b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:46.412828 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cf8048ac-3c28-4ea2-b865-cd988447b36b tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.074214 Jul 19 21:08:46.413631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 545/1091] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:46 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:47.434824 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6f2f1ec6-a8df-4496-b2b7-aad3ad19a7e0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:47.436142 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6f2f1ec6-a8df-4496-b2b7-aad3ad19a7e0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:47.494518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6f2f1ec6-a8df-4496-b2b7-aad3ad19a7e0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:47.502793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6f2f1ec6-a8df-4496-b2b7-aad3ad19a7e0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.074889 Jul 19 21:08:47.503398 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 547/1092] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:47 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:48.519979 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-05a457ff-19c6-4cd6-968a-b61aa5b06e5c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:48.520631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-05a457ff-19c6-4cd6-968a-b61aa5b06e5c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:48.605057 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-05a457ff-19c6-4cd6-968a-b61aa5b06e5c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:48.614783 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-05a457ff-19c6-4cd6-968a-b61aa5b06e5c tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.098755 Jul 19 21:08:48.615367 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 546/1093] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:48 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:49.632510 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ce8970c3-2c46-4f58-a20a-1fa4c5ab2be0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:49.633086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ce8970c3-2c46-4f58-a20a-1fa4c5ab2be0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:49.696660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ce8970c3-2c46-4f58-a20a-1fa4c5ab2be0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:49.704372 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ce8970c3-2c46-4f58-a20a-1fa4c5ab2be0 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.075825 Jul 19 21:08:49.704952 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 548/1094] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:49 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:50.722433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8cb3e39b-6abc-428d-81d1-d4f8810d80da tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:50.723165 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8cb3e39b-6abc-428d-81d1-d4f8810d80da tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:50.782917 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-8cb3e39b-6abc-428d-81d1-d4f8810d80da tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:50.791710 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8cb3e39b-6abc-428d-81d1-d4f8810d80da tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.074017 Jul 19 21:08:50.792640 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 547/1095] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:50 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:51.812481 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f01762b7-dcc7-4490-9af9-cfd882fc515a tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:51.813136 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f01762b7-dcc7-4490-9af9-cfd882fc515a tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:51.878487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f01762b7-dcc7-4490-9af9-cfd882fc515a tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:51.888785 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f01762b7-dcc7-4490-9af9-cfd882fc515a tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.081563 Jul 19 21:08:51.890404 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 549/1096] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:51 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:52.916462 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9a209adb-f4cf-42b8-b046-cb9bfa822c34 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:52.917162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9a209adb-f4cf-42b8-b046-cb9bfa822c34 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:52.919784 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:52.982590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9a209adb-f4cf-42b8-b046-cb9bfa822c34 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:52.990473 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9a209adb-f4cf-42b8-b046-cb9bfa822c34 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.078654 Jul 19 21:08:52.991116 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 548/1097] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:52 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:54.009595 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c8d6aaa7-381e-40ef-9a7d-4272a1307897 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:54.010540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c8d6aaa7-381e-40ef-9a7d-4272a1307897 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:54.093819 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c8d6aaa7-381e-40ef-9a7d-4272a1307897 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:54.101408 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c8d6aaa7-381e-40ef-9a7d-4272a1307897 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.095915 Jul 19 21:08:54.102244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 550/1098] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:54 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:55.127180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fa13ea90-2ee9-4b7c-b7df-0dd091ad53d5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:55.127881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fa13ea90-2ee9-4b7c-b7df-0dd091ad53d5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:55.183373 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-fa13ea90-2ee9-4b7c-b7df-0dd091ad53d5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:55.190425 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fa13ea90-2ee9-4b7c-b7df-0dd091ad53d5 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.067292 Jul 19 21:08:55.191027 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 549/1099] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:55 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:56.216019 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-2fb4c485-2a69-4b4f-97de-4f4dce7dec7d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:56.216822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-2fb4c485-2a69-4b4f-97de-4f4dce7dec7d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:56.220146 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:08:56.276307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-2fb4c485-2a69-4b4f-97de-4f4dce7dec7d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:56.284415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-2fb4c485-2a69-4b4f-97de-4f4dce7dec7d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.074421 Jul 19 21:08:56.285003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 551/1100] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:56 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:57.302396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-dda28c26-3ea9-4fa9-bf0f-a1b0aa1726a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:57.303024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-dda28c26-3ea9-4fa9-bf0f-a1b0aa1726a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:57.361052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-dda28c26-3ea9-4fa9-bf0f-a1b0aa1726a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:57.370578 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-dda28c26-3ea9-4fa9-bf0f-a1b0aa1726a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.072654 Jul 19 21:08:57.371205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 550/1101] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:57 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:08:58.387522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4db56d6a-79c5-499b-81b4-307d8292516e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:58.388189 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4db56d6a-79c5-499b-81b4-307d8292516e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:58.445012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4db56d6a-79c5-499b-81b4-307d8292516e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:58.452813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4db56d6a-79c5-499b-81b4-307d8292516e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.068975 Jul 19 21:08:58.453535 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 552/1102] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:58 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:08:59.471089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e79380cd-77e2-4432-b24d-1a60536165a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:08:59.471780 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e79380cd-77e2-4432-b24d-1a60536165a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:08:59.533357 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e79380cd-77e2-4432-b24d-1a60536165a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:08:59.542196 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e79380cd-77e2-4432-b24d-1a60536165a4 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.075865 Jul 19 21:08:59.542831 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 551/1103] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:08:59 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:00.560160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-82585408-f0f5-433d-919f-0afb93c3ae50 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:00.561695 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-82585408-f0f5-433d-919f-0afb93c3ae50 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:00.620766 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-82585408-f0f5-433d-919f-0afb93c3ae50 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:00.628443 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-82585408-f0f5-433d-919f-0afb93c3ae50 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.072597 Jul 19 21:09:00.629055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 553/1104] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:00 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:01.647537 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6169cf43-9dd7-459c-8e2d-54999bb7f57d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:01.648144 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6169cf43-9dd7-459c-8e2d-54999bb7f57d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:01.709444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6169cf43-9dd7-459c-8e2d-54999bb7f57d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:01.716793 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6169cf43-9dd7-459c-8e2d-54999bb7f57d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.073645 Jul 19 21:09:01.717389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 552/1105] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:01 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:02.744308 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ccc36169-3b56-4e63-9ecf-9211f087d309 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:02.744942 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ccc36169-3b56-4e63-9ecf-9211f087d309 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:02.818885 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ccc36169-3b56-4e63-9ecf-9211f087d309 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:02.827013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ccc36169-3b56-4e63-9ecf-9211f087d309 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.087395 Jul 19 21:09:02.827695 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 554/1106] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:02 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:03.845362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bca3c2cc-9195-4475-a30b-608681123c0d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:03.846012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bca3c2cc-9195-4475-a30b-608681123c0d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:03.904261 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bca3c2cc-9195-4475-a30b-608681123c0d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:03.912873 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bca3c2cc-9195-4475-a30b-608681123c0d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.071860 Jul 19 21:09:03.913511 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 553/1107] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:03 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:04.931816 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-eb7a8aa6-0fff-41d1-8b4f-bec2a3b59342 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:04.932526 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-eb7a8aa6-0fff-41d1-8b4f-bec2a3b59342 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:04.988107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-eb7a8aa6-0fff-41d1-8b4f-bec2a3b59342 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:04.995147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-eb7a8aa6-0fff-41d1-8b4f-bec2a3b59342 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.067860 Jul 19 21:09:04.995722 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 555/1108] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:04 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:06.020229 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-e9f688a3-2374-4ce3-b723-953f229fad43 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:06.021271 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-e9f688a3-2374-4ce3-b723-953f229fad43 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:06.023798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=78 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:06.086524 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-e9f688a3-2374-4ce3-b723-953f229fad43 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:06.089027 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=38 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:06.095987 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-e9f688a3-2374-4ce3-b723-953f229fad43 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.080224 Jul 19 21:09:06.096603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 554/1109] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:06 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:07.114606 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ecf50469-d11d-4203-82b2-08fbe3b81b5e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:07.115522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ecf50469-d11d-4203-82b2-08fbe3b81b5e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:07.118039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=56 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:07.192916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-ecf50469-d11d-4203-82b2-08fbe3b81b5e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:07.201458 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ecf50469-d11d-4203-82b2-08fbe3b81b5e tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1258 microversion: 2.1 time: 0.091237 Jul 19 21:09:07.202233 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 556/1110] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:07 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:08.223113 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:08.223941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:08.232438 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:08.232889 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:08.234269 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:08.234722 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:08.328851 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:08.329510 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:08.330423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lazy-loading 'fault' on Instance uuid 319d0165-c4e9-4e86-b6a7-038a9c378da3 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:09:08.382982 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f649ce79152d4d23866dde7dbe067ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ea12b35ccb471284d0bfde7d24089b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:08.399434 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4a6911a4-3e27-4c26-b6db-cf80baf56670 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 200 len: 1322 microversion: 2.1 time: 0.180452 Jul 19 21:09:08.400024 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 555/1111] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:08 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:08.417802 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:08.418403 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:08.426440 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:08.426881 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:08.427665 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:08.428097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:08.507096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:09:08.623039 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=124278) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 19 21:09:08.623932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:08.624393 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:08.624843 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: WARNING nova.compute.api [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] instance's host None is down, deleting from database Jul 19 21:09:08.630130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] deallocate_for_instance() {{(pid=124278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 19 21:09:08.667901 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Instance cache missing network info. {{(pid=124278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jul 19 21:09:08.677157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Updating instance_info_cache with network_info: [] {{(pid=124278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 19 21:09:09.036477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b72f6bac-f2b4-426d-8a57-8444debb1e65 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "DELETE /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 204 len: 0 microversion: 2.1 time: 0.623042 Jul 19 21:09:09.036978 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 557/1112] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:09:08 2022] DELETE /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:09:09.046596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:09.047302 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] [instance: 319d0165-c4e9-4e86-b6a7-038a9c378da3] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:09.054504 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:09.054972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:09.055761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:09.056200 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:09.070703 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] HTTP exception thrown: Instance 319d0165-c4e9-4e86-b6a7-038a9c378da3 could not be found. Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Request method failure captured: Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 HTTP/1.1 Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1x0gQE1pOne94zK1TzbBdKx9ttqXCDtpT2_Gm7kYtMxhE1IO5JOcquiGxMjrWM53pLALsiwMTui3bGSa8s5ODVg7V03VOLTOOibF2L9PTUFV6SRNMrUEbYZtOg5NHVNXAgknXm9Pc6a-w5IG7SctEQ00Fy1-X1ahpWbk9IL1ayKaMDA Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 41ea12b35ccb471284d0bfde7d24089b Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-TestMinimumBasicScenario-1853900580 Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:09:09.072736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/41ea12b35ccb471284d0bfde7d24089b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/41ea12b35ccb471284d0bfde7d24089b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/41ea12b35ccb471284d0bfde7d24089b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_41ea12b35ccb471284d0bfde7d24089b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-TestMinimumBasicScenario-1853900580 Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 41ea12b35ccb471284d0bfde7d24089b Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1853900580 Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-TestMinimumBasicScenario-1853900580-project Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: f649ce79152d4d23866dde7dbe067ea1 Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-TestMinimumBasicScenario-1853900580-project Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 319d0165-c4e9-4e86-b6a7-038a9c378da3 could not be found. Jul 19 21:09:09.074558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '319d0165-c4e9-4e86-b6a7-038a9c378da3'} Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319d0165-c4e9-4e86-b6a7-038a9c378da3 could not be found. Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:09:09.075572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319d0165-c4e9-4e86-b6a7-038a9c378da3 could not be found. Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319d0165-c4e9-4e86-b6a7-038a9c378da3 could not be found. Jul 19 21:09:09.077249 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:09:09.078677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Returning 404 to user: Instance 319d0165-c4e9-4e86-b6a7-038a9c378da3 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:09:09.078677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-01456401-caf5-4d0a-a40f-96153ae0ef8d tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3" status: 404 len: 111 microversion: 2.1 time: 0.032776 Jul 19 21:09:09.078677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 556/1113] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:09 2022] GET /compute/v2.1/servers/319d0165-c4e9-4e86-b6a7-038a9c378da3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:09:09.087628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-29e6d30e-ff75-4fed-9e22-51fac92ca623 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] Calling method '.version_select at 0x7f125f39fee0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:09.112724 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-29e6d30e-ff75-4fed-9e22-51fac92ca623 tempest-TestMinimumBasicScenario-1853900580 tempest-TestMinimumBasicScenario-1853900580-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-490122489" status: 202 len: 0 microversion: 2.1 time: 0.029511 Jul 19 21:09:09.113441 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 558/1114] 10.222.0.85 () {58 vars in 1268 bytes} [Tue Jul 19 21:09:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-490122489 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:09:48.729861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:48.730496 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:48.732569 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:48.733228 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=9 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:48.733921 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=10 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:48.741081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:48.741523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:48.742314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:48.742950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:49.031869 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lazy-loading 'services' on Instance uuid 73c20534-0f18-4ec7-b2c9-017e359ea7d5 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:09:49.107972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-95f8affd-d0ad-444f-b35c-7cd05acc03d8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-volume_attachments/9f5ee2c1-3443-4c8f-b35a-e25b0f9409cb" status: 202 len: 0 microversion: 2.1 time: 0.381845 Jul 19 21:09:49.108653 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 557/1115] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:09:48 2022] DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-volume_attachments/9f5ee2c1-3443-4c8f-b35a-e25b0f9409cb => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:09:50.231877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=20 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:50.235225 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:50.235225 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:09:50.238673 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5f0dda72-aea1-4e42-b7e8-8232b65b557b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:09:50.248777 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f0dda72-aea1-4e42-b7e8-8232b65b557b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:50.249232 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5f0dda72-aea1-4e42-b7e8-8232b65b557b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:50.316923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5f0dda72-aea1-4e42-b7e8-8232b65b557b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Going to try to stop instance {{(pid=124278) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 21:09:50.365338 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5f0dda72-aea1-4e42-b7e8-8232b65b557b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.134407 Jul 19 21:09:50.366445 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 559/1116] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:09:50 2022] POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:09:50.375924 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:50.376704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:50.383430 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:50.384158 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:50.384986 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:50.385409 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:50.523506 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:50.531879 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-74ad061a-81aa-436e-a731-9c338255ac6f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.160839 Jul 19 21:09:50.532675 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 558/1117] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:50 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:51.551011 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:51.551635 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:51.557914 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:51.558360 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:51.559133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:51.559565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:51.811488 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:51.819793 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-da5c14ca-e80d-4855-8cf7-6cb7e24f4525 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.273390 Jul 19 21:09:51.820409 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 560/1118] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:51 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:52.839809 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:52.840455 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:52.847305 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:52.847909 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:52.849052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:52.849275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:53.001646 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:53.010621 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-32b5c8d6-b759-4d51-826c-0aa8ca4f524b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.174635 Jul 19 21:09:53.011201 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 559/1119] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:52 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:54.030773 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:54.031395 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:54.038053 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:54.038501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:54.039275 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:54.039720 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:54.175448 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:54.182790 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-64a37e70-ad4a-4800-9eab-927f5852bcce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.156066 Jul 19 21:09:54.183348 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 561/1120] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:54 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:55.201708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:55.202345 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:55.209095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:55.209548 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:55.210363 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:55.210803 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:55.341454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:55.349068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ccd5a4b2-e882-482d-bab1-d31970c039e2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.151848 Jul 19 21:09:55.349626 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 560/1121] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:55 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:56.365984 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:56.366530 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:56.373514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.373973 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.374703 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:56.375124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:56.507600 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:56.515799 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0519bab4-8131-4e67-88f7-49f0bf561ae3 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.153658 Jul 19 21:09:56.516412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 562/1122] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:56 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:57.532862 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:57.533411 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:57.539529 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:57.539985 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:57.540799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:57.541242 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:57.676552 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:57.684009 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a9e7bd42-70a2-4039-b7ae-d696b8602d25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.155123 Jul 19 21:09:57.684603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 561/1123] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:57 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:58.701319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:58.701945 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:58.708484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:58.708932 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:58.709698 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:58.710130 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:58.845358 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:09:58.853208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-999d12d6-4608-4563-bc58-420329e25c07 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.155686 Jul 19 21:09:58.853773 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 563/1124] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:58 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:09:59.870875 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:09:59.871501 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:09:59.878213 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:59.878785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:09:59.879420 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:09:59.879859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:00.010302 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:00.017878 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6afe7aca-490c-417e-90b7-e4bb385a70be tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1677 microversion: 2.1 time: 0.150887 Jul 19 21:10:00.018433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 562/1125] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:09:59 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:01.035451 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:01.036119 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:01.042764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.043215 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:01.043979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.044574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:01.176263 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:01.183776 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b83b3242-bf2b-402f-80ad-6e8a03845e61 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1654 microversion: 2.1 time: 0.152185 Jul 19 21:10:01.184364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 564/1126] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:01 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:01.200956 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-24172cea-bf3a-45d1-8bc8-bc63a1410da1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:10:01.207984 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-24172cea-bf3a-45d1-8bc8-bc63a1410da1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.208475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-24172cea-bf3a-45d1-8bc8-bc63a1410da1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:01.231603 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-24172cea-bf3a-45d1-8bc8-bc63a1410da1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Going to try to start instance {{(pid=124277) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 21:10:01.274378 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-24172cea-bf3a-45d1-8bc8-bc63a1410da1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.077851 Jul 19 21:10:01.275167 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 563/1127] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:10:01 2022] POST /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:10:01.283154 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:01.284374 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:01.290271 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.290621 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:01.291454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:01.291917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:01.434642 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:01.444228 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-00a6148a-9d2f-475b-8fef-ad92578a1276 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1663 microversion: 2.1 time: 0.164855 Jul 19 21:10:01.444837 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 565/1128] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:01 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:02.464018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:02.464733 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:02.472741 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:02.473092 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:02.473674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:02.474079 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:02.614003 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:02.621668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-caf001dc-42a5-4728-82c7-b2cae31fd7c5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1663 microversion: 2.1 time: 0.162486 Jul 19 21:10:02.622240 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 564/1129] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:02 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:10:03.640232 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:10:03.641281 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:10:03.648277 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.648750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.649519 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:10:03.649957 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:10:03.785002 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:10:03.792571 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b70225bb-e395-4447-96f3-557396db970d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1667 microversion: 2.1 time: 0.156935 Jul 19 21:10:03.793137 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 566/1130] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:10:03 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:07.741365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=16 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:07.742149 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:07.746155 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:07.747144 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:07.754968 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:07.755413 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:07.756175 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:07.756636 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:07.785691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-8f9932d7-bf7c-4e61-9096-bc7838d05df2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046214 Jul 19 21:11:07.786272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 565/1131] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:11:07 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:11:07.841939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=16 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:07.842679 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:07.846564 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:07.847050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:07.853996 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:07.854441 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:07.855200 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:07.855631 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:07.883313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:11:07.966806 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c2d72ac3-18d1-4fb9-8c72-baef1ed017c7 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 204 len: 0 microversion: 2.1 time: 0.126309 Jul 19 21:11:07.967507 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 567/1132] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:11:07 2022] DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:11:07.976080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:07.976668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:07.982644 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:07.983095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:07.984484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:07.984932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:08.119752 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:08.127509 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-a60283bf-5e64-48e7-a74d-6c7b5adf49ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1673 microversion: 2.1 time: 0.155337 Jul 19 21:11:08.128077 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 566/1133] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:07 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:09.145540 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:09.146243 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:09.152889 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:09.153334 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:09.154097 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:09.154528 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:09.284412 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:09.291796 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-149690fc-78d1-4234-84a9-983f4f13ec28 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1673 microversion: 2.1 time: 0.150593 Jul 19 21:11:09.292375 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 568/1134] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:09 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:10.309572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:10.310166 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:10.316807 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:10.317257 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:10.318023 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:10.318697 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:10.464695 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:10.467397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-5c59f0f9-bb87-4138-b3c3-9eb8e12354bf tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1673 microversion: 2.1 time: 0.161050 Jul 19 21:11:10.467397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 567/1135] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:10 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:11.266452 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-523d04ed-04c3-4e57-a71c-680bbe41d014 req-f4b88f09-7124-4df1-90b0-2082790cc19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c20534-0f18-4ec7-b2c9-017e359ea7d5", "name": "network-vif-deleted", "tag": "4a8444d8-c8fc-4d26-baed-0a1ea1ec734c"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:11.276585 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-523d04ed-04c3-4e57-a71c-680bbe41d014 req-f4b88f09-7124-4df1-90b0-2082790cc19b service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:11.277249 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-523d04ed-04c3-4e57-a71c-680bbe41d014 req-f4b88f09-7124-4df1-90b0-2082790cc19b service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:11.289907 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-523d04ed-04c3-4e57-a71c-680bbe41d014 req-f4b88f09-7124-4df1-90b0-2082790cc19b service nova] Creating event network-vif-deleted:4a8444d8-c8fc-4d26-baed-0a1ea1ec734c for instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 on hv-cinder-74915 Jul 19 21:11:11.295763 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-523d04ed-04c3-4e57-a71c-680bbe41d014 req-f4b88f09-7124-4df1-90b0-2082790cc19b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 Jul 19 21:11:11.297977 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 569/1136] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:11.487898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:11.488785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:11.498881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:11.500013 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:11.501460 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:11.502073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:11.539185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:11.539668 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:11.540112 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lazy-loading 'fault' on Instance uuid 73c20534-0f18-4ec7-b2c9-017e359ea7d5 {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:11:11.588210 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:11.600469 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eb7d39e4-d9b0-43ec-8d06-944a62e49ccc tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 200 len: 1326 microversion: 2.1 time: 0.118531 Jul 19 21:11:11.601061 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 568/1137] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:11 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 1326 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:11.910564 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:11:11.910836 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:11:12.619599 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:12.620203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:12.627640 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:12.628085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:12.628958 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:12.629392 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:12.643293 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] HTTP exception thrown: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Request method failure captured: Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 HTTP/1.1 Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xzNmuwzRWf3wpZOVcMH6WlY6FtSeIfVBjExaN9GIH18fniJNcqszAiW1mzJUGBUFps9uBgWJSNA7aAwaw-C0_14y9g7i1VF1hcDoGMS5r7i7ObVdXGzhaYt61bOCi3pFHNQuh-Tb6ON9N1h933GCyFb6Zb4bV-iONwKMbUi3CKHuPo Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:11:12.644928 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 187add5855314ff5b802b74297a6e7b0 Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:11:12.646649 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '73c20534-0f18-4ec7-b2c9-017e359ea7d5'} Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:11:12.647675 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:11:12.649319 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:11:12.650779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Returning 404 to user: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:11:12.650779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0fc27738-cfad-42fb-9bbf-7a127309bb99 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 404 len: 111 microversion: 2.1 time: 0.031025 Jul 19 21:11:12.650779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 570/1138] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:12 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:11:12.655162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-50ee2df7-f4cb-44b2-b4fc-90e293987fb0 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '.version_select at 0x7f125f47af70>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:12.675468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-50ee2df7-f4cb-44b2-b4fc-90e293987fb0 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264335920" status: 202 len: 0 microversion: 2.1 time: 0.024044 Jul 19 21:11:12.676033 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 569/1139] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jul 19 21:11:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264335920 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 21:11:13.299619 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-860ffd10-9a4e-4a2a-ab9f-60dca29944ab tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: .version_select at 0x7f125f788c10>, body: {"keypair": {"name": "tempest-keypair-279943647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk4hqfLtTyEa1muU9/syaToyRKfaO7uSUCJQRzuQZIwCb5zJJhN5TjVLYTng9MsrRo/PEzmPJlTFhE8oM6R4B2uqJl+qU7ibY9K2uBoNzzHl/KWP9jmVrIH2WxYxurYhQ=="}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:13.313288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-860ffd10-9a4e-4a2a-ab9f-60dca29944ab tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:11:13.317056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-860ffd10-9a4e-4a2a-ab9f-60dca29944ab tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for user 187add5855314ff5b802b74297a6e7b0 and project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'key_pairs'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:11:13.341288 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-860ffd10-9a4e-4a2a-ab9f-60dca29944ab tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046052 Jul 19 21:11:13.341888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 571/1140] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 21:11:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:14.639053 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1866676585", "imageRef": "7911f3d0-6074-4404-b641-f07acd43ad10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbc738d-9672-4a71-90ac-816b2d7db1a9"}], "security_groups": [{"name": "tempest-securitygroup--2140950643"}], "key_name": "tempest-keypair-279943647", "user_data": "}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:14.751562 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.network.neutron [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] validate_networks() for [('1fbc738d-9672-4a71-90ac-816b2d7db1a9', None, None, None, None, None)] {{(pid=124277) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:11:15.166558 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Flavor limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:11:15.166982 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Image limits 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:11:15.167475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Flavor pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:11:15.167881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Image pref 0:0:0 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:11:15.168283 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.virt.hardware [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:11:15.179006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:15.179446 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:15.180244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:15.180719 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:15.197988 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:11:15.201886 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Getting quotas for user 187add5855314ff5b802b74297a6e7b0 and project cb315d23f40a4d1bbe9828c1d3a4e5a7. Resources: {'ram', 'instances', 'cores'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:11:15.213412 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Going to run 1 instances... {{(pid=124277) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:11:15.215748 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7911f3d0-6074-4404-b641-f07acd43ad10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:11:15.264449 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [22afdc1f-2bed-403e-b23f-4baa3070b2f1] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:11:16.272756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [22afdc1f-2bed-403e-b23f-4baa3070b2f1] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 33190. Jul 19 21:11:16.276559 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-80287709-ebfe-4265-8749-9be8efc2ea6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.642501 Jul 19 21:11:16.277215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 570/1141] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:11:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:11:16.287628 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f6dc8f58-84f1-47cc-8a72-4c9f5f3c64df tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:16.288210 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f6dc8f58-84f1-47cc-8a72-4c9f5f3c64df tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:16.344116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-f6dc8f58-84f1-47cc-8a72-4c9f5f3c64df tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:16.350864 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f6dc8f58-84f1-47cc-8a72-4c9f5f3c64df tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1237 microversion: 2.1 time: 0.067553 Jul 19 21:11:16.351429 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 572/1142] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:16 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:17.367697 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-b5ace21c-9a0d-4286-a4bc-763486de05a1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:17.368348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-b5ace21c-9a0d-4286-a4bc-763486de05a1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:17.421991 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-b5ace21c-9a0d-4286-a4bc-763486de05a1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:17.428932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-b5ace21c-9a0d-4286-a4bc-763486de05a1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1237 microversion: 2.1 time: 0.065097 Jul 19 21:11:17.429484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 571/1143] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:17 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:18.445587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9dc25277-ddfa-4c0d-8362-94125adb2ffa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:18.446262 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9dc25277-ddfa-4c0d-8362-94125adb2ffa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:18.500557 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9dc25277-ddfa-4c0d-8362-94125adb2ffa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:18.512203 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9dc25277-ddfa-4c0d-8362-94125adb2ffa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1237 microversion: 2.1 time: 0.070329 Jul 19 21:11:18.512754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 573/1144] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:18 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:11:19.528920 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f0dde063-98b2-439e-b1cb-d7561ede820f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:19.529538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f0dde063-98b2-439e-b1cb-d7561ede820f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:19.852103 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f0dde063-98b2-439e-b1cb-d7561ede820f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:19.859596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f0dde063-98b2-439e-b1cb-d7561ede820f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1237 microversion: 2.1 time: 0.333962 Jul 19 21:11:19.860163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 572/1145] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:19 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1237 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:20.876969 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:20.877575 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:20.885197 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:20.885634 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:20.886400 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:20.886832 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:20.954169 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:20.962518 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-781829d4-fbe9-4749-bd1c-47a5c902bed1 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1233 microversion: 2.1 time: 0.089931 Jul 19 21:11:20.963092 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 574/1146] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:20 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1233 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:22.054606 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:22.055268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:22.062899 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:22.063484 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:22.064921 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:22.065432 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:22.238557 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:22.248264 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-85927e27-a6fc-4af3-b512-2e750fefa4ce tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.270824 Jul 19 21:11:22.248970 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 573/1147] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:21 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:22.894783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-0c7c0f59-5ab2-408d-8369-0e99bb21aa15 req-1bfde24e-2413-4ac6-96c6-48cae8cd6104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456b05d-e74b-4b53-bac1-38abb22986cf", "tag": "24845303-1965-4326-8afa-08b6f4d5b13f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:22.915424 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-0c7c0f59-5ab2-408d-8369-0e99bb21aa15 req-1bfde24e-2413-4ac6-96c6-48cae8cd6104 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:22.915998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-0c7c0f59-5ab2-408d-8369-0e99bb21aa15 req-1bfde24e-2413-4ac6-96c6-48cae8cd6104 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:22.932237 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-0c7c0f59-5ab2-408d-8369-0e99bb21aa15 req-1bfde24e-2413-4ac6-96c6-48cae8cd6104 service nova] Creating event network-changed:24845303-1965-4326-8afa-08b6f4d5b13f for instance c456b05d-e74b-4b53-bac1-38abb22986cf on hv-cinder-74915 Jul 19 21:11:22.939374 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-0c7c0f59-5ab2-408d-8369-0e99bb21aa15 req-1bfde24e-2413-4ac6-96c6-48cae8cd6104 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051747 Jul 19 21:11:22.940362 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 575/1148] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:23.267452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:23.268068 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:23.275992 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:23.276497 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:23.277289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:23.277730 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:23.419357 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:23.427286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9723513a-2769-4fd8-8cea-d47bd5c2c001 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.164153 Jul 19 21:11:23.427767 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 574/1149] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:23 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:24.444830 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:24.445527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:24.452477 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:24.452923 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:24.453680 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:24.454111 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:24.584261 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:24.591761 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-88c26ac5-fefc-4a34-92d9-6e8faa77dd25 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.151195 Jul 19 21:11:24.592342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 576/1150] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:24 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:25.609839 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:25.610463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:25.612997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:25.620007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:25.620503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:25.621300 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:25.621745 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:25.770073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:25.777624 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c1227ca9-f270-47aa-94ae-c18920d6a0fa tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.172250 Jul 19 21:11:25.778198 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 575/1151] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:25 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:26.794574 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:26.795190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:26.803042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:26.803499 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:26.804301 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:26.804842 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:26.940716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:26.949272 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c69a8113-5025-443e-bb4e-b7e0a63b4eb2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.158461 Jul 19 21:11:26.949849 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 577/1152] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:26 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:27.967286 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:27.967881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:27.974727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:27.975182 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:27.975972 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:27.976442 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:28.125669 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:28.135237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-7bfef0c3-bf34-4bcc-8941-344c0df1ef7e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.171578 Jul 19 21:11:28.136148 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 576/1153] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:27 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:28.163637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-d096c238-1b90-4314-940c-344ab9364e5b req-d22359b7-ef79-41f5-ab9a-80412f0a690d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456b05d-e74b-4b53-bac1-38abb22986cf", "name": "network-vif-plugged", "status": "completed", "tag": "24845303-1965-4326-8afa-08b6f4d5b13f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:28.173389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d096c238-1b90-4314-940c-344ab9364e5b req-d22359b7-ef79-41f5-ab9a-80412f0a690d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:28.173840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-d096c238-1b90-4314-940c-344ab9364e5b req-d22359b7-ef79-41f5-ab9a-80412f0a690d service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:28.185065 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-d096c238-1b90-4314-940c-344ab9364e5b req-d22359b7-ef79-41f5-ab9a-80412f0a690d service nova] Creating event network-vif-plugged:24845303-1965-4326-8afa-08b6f4d5b13f for instance c456b05d-e74b-4b53-bac1-38abb22986cf on hv-cinder-74915 Jul 19 21:11:28.190551 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-d096c238-1b90-4314-940c-344ab9364e5b req-d22359b7-ef79-41f5-ab9a-80412f0a690d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Jul 19 21:11:28.191155 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 578/1154] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:29.153707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:29.154306 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:29.161629 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:29.162073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:29.162847 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:29.163280 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:29.339458 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:29.347694 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-af20a9bb-431f-4c10-a83a-9bedcfdc2a9d tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1363 microversion: 2.1 time: 0.197800 Jul 19 21:11:29.348267 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 577/1155] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:29 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:30.364906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=8 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:30.369798 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:30.370536 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:30.377729 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:30.378168 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:30.378921 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:30.379690 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:30.532615 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:11:30.541050 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-0ab06c10-c43e-42d4-bdf6-512f919ac83f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1549 microversion: 2.1 time: 0.176581 Jul 19 21:11:30.541501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 579/1156] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:11:30 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:11:30.558568 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:11:30.559163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:11:30.561003 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=10 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:11:30.567596 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:30.568035 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:30.568861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:30.569287 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:30.664468 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f954b42c-5be6-446d-a209-7c1672d48751 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109881 Jul 19 21:11:30.665089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 578/1157] 10.222.0.85 () {58 vars in 1274 bytes} [Tue Jul 19 21:11:30 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:11:31.901567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-5220dd68-39d7-44a0-90c4-3b67e6af8b08 req-8888a19c-a151-418e-b754-05987bf14080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456b05d-e74b-4b53-bac1-38abb22986cf", "tag": "24845303-1965-4326-8afa-08b6f4d5b13f"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:11:31.912639 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5220dd68-39d7-44a0-90c4-3b67e6af8b08 req-8888a19c-a151-418e-b754-05987bf14080 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:11:31.913068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5220dd68-39d7-44a0-90c4-3b67e6af8b08 req-8888a19c-a151-418e-b754-05987bf14080 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:11:31.924947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-5220dd68-39d7-44a0-90c4-3b67e6af8b08 req-8888a19c-a151-418e-b754-05987bf14080 service nova] Creating event network-changed:24845303-1965-4326-8afa-08b6f4d5b13f for instance c456b05d-e74b-4b53-bac1-38abb22986cf on hv-cinder-74915 Jul 19 21:11:31.929857 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-5220dd68-39d7-44a0-90c4-3b67e6af8b08 req-8888a19c-a151-418e-b754-05987bf14080 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032214 Jul 19 21:11:31.930396 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 580/1158] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:47.286685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:47.287609 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=62 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:47.292567 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:47.293081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:47.301692 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:47.302136 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:47.302977 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:47.303408 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:47.329209 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-fe3b0ac9-4bfe-4056-8e8e-32e6389904fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/ips" status: 200 len: 146 microversion: 2.1 time: 0.044557 Jul 19 21:12:47.329955 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 579/1159] 10.222.0.85 () {58 vars in 1247 bytes} [Tue Jul 19 21:12:47 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 21:12:48.698775 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:48.699687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:12:48.704626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4"}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:48.705808 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:48.714399 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:48.714840 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:48.715613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:48.716040 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:48.989789 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4c3628cb-ef3e-4810-bcfb-d81be07b1836 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293120 Jul 19 21:12:48.990414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 581/1160] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:12:48 2022] POST /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:56.556454 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:56.558941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:56.565861 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:56.566407 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:56.567194 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:56.567632 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:56.598867 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c8fbb23f-f417-466d-b5a4-f1fa5ed90390 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Jul 19 21:12:56.599727 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 580/1161] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:12:56 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:56.611017 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:12:56.611622 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:56.619419 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:56.619867 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:56.620667 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:56.621096 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:56.651899 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-be3ed231-1b06-4578-a9cd-193eebbf1aa8 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4" status: 200 len: 194 microversion: 2.1 time: 0.045417 Jul 19 21:12:56.652682 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 582/1162] 10.222.0.85 () {58 vars in 1412 bytes} [Tue Jul 19 21:12:56 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:12:57.978564 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68778078-9591-43f4-932c-70a85e073149"}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:12:57.979623 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:12:57.986275 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:57.986718 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:57.987721 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:12:57.988162 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:12:58.249953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6768cdab-1f22-4b9b-b089-99e254301715 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "POST /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275074 Jul 19 21:12:58.250559 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 581/1163] 10.222.0.85 () {60 vars in 1322 bytes} [Tue Jul 19 21:12:57 2022] POST /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:05.734324 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:05.735244 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:05.741813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:05.742259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:05.743020 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:05.743457 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:05.774045 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a4cbb3ed-96ad-4dff-a29c-3afe445ad51a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043705 Jul 19 21:13:05.774594 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 583/1164] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:13:05 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:05.922915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:05.923482 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:05.930314 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:05.930756 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:05.931525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:05.931959 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:05.961006 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-eaf78040-4762-433b-8833-dc35757ebd6b tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4" status: 200 len: 194 microversion: 2.1 time: 0.042876 Jul 19 21:13:05.961582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 582/1165] 10.222.0.85 () {58 vars in 1412 bytes} [Tue Jul 19 21:13:05 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:05.971850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:05.972380 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:05.979532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:05.979980 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:05.980781 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:05.981221 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:06.062930 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lazy-loading 'services' on Instance uuid c456b05d-e74b-4b53-bac1-38abb22986cf {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:13:06.133985 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-485f2cd0-8a44-4dc1-a4cf-67941091c90a tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4" status: 202 len: 0 microversion: 2.1 time: 0.166510 Jul 19 21:13:06.134558 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 584/1166] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:13:05 2022] DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/c868c4ab-0a25-40a0-8bef-cf1bb17e2cb4 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:13:06.786562 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:13:06.787259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:13:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:13:08.300926 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:08.301465 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:08.307907 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:08.308381 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:08.309142 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:08.309581 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:08.338382 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-057fad13-7633-430a-864d-1eb21a1d2e6e tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/68778078-9591-43f4-932c-70a85e073149" status: 200 len: 194 microversion: 2.1 time: 0.041304 Jul 19 21:13:08.338961 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 583/1167] 10.222.0.85 () {58 vars in 1412 bytes} [Tue Jul 19 21:13:08 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/68778078-9591-43f4-932c-70a85e073149 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:08.350364 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:08.350944 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:08.357230 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:08.357676 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:08.358433 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:08.358873 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:08.441893 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lazy-loading 'services' on Instance uuid c456b05d-e74b-4b53-bac1-38abb22986cf {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:13:08.511460 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-ace96f25-4e7c-464b-ab70-78377e3790af tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/68778078-9591-43f4-932c-70a85e073149" status: 202 len: 0 microversion: 2.1 time: 0.166239 Jul 19 21:13:08.512033 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 585/1168] 10.222.0.85 () {58 vars in 1415 bytes} [Tue Jul 19 21:13:08 2022] DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments/68778078-9591-43f4-932c-70a85e073149 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:13:09.674641 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:09.675678 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:09.682166 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:09.682615 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:09.683389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:09.683827 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:09.714123 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9c4dbfbc-965d-40a1-876f-84f02d685be2 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043808 Jul 19 21:13:09.714688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 584/1169] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:13:09 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:13:09.823745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:09.824828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:09.831456 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:09.832106 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:09.834042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:09.834042 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:09.862340 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-efcb3fce-8d71-4d3d-8050-2b0f447fa9fd tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043307 Jul 19 21:13:09.862888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 586/1170] 10.222.0.85 () {58 vars in 1301 bytes} [Tue Jul 19 21:13:09 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 21:13:09.919347 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:09.919878 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:09.926456 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:09.926906 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:09.927676 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:09.928109 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:09.954389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Going to try to terminate instance {{(pid=124277) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:13:10.028311 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-47126d29-39a3-4f30-aec2-a798efc11b8f tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 204 len: 0 microversion: 2.1 time: 0.112453 Jul 19 21:13:10.028941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 585/1171] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:13:09 2022] DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:13:10.037714 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:10.038316 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:10.044589 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:10.045024 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:10.045774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:10.046195 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:10.185198 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:10.192750 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6c6ee3fe-33b9-4290-be43-95f98e837e60 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1674 microversion: 2.1 time: 0.159157 Jul 19 21:13:10.193328 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 587/1172] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:10 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:11.210288 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:11.211020 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:11.217725 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:11.218175 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:11.218957 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:11.219421 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:11.350699 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:11.358211 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ffa93503-0639-4606-babb-e059b6c2dad5 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1674 microversion: 2.1 time: 0.152187 Jul 19 21:13:11.358761 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 586/1173] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:11 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:12.376093 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:12.377012 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:12.384177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:12.384511 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:12.385279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:12.385713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:12.524414 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:12.531848 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7b7b3d6a-a6e3-4592-bcbd-47cbe2b48b18 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1674 microversion: 2.1 time: 0.159813 Jul 19 21:13:12.532432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 588/1174] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:12 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:13:13.256026 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-5ed24752-c69a-4f08-bffc-a539758da9f0 req-5a7b1b7c-17f9-4a9f-90d0-86cc4ff4dc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456b05d-e74b-4b53-bac1-38abb22986cf", "name": "network-vif-deleted", "tag": "24845303-1965-4326-8afa-08b6f4d5b13f"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:13:13.266794 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5ed24752-c69a-4f08-bffc-a539758da9f0 req-5a7b1b7c-17f9-4a9f-90d0-86cc4ff4dc17 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:13.267415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-5ed24752-c69a-4f08-bffc-a539758da9f0 req-5a7b1b7c-17f9-4a9f-90d0-86cc4ff4dc17 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:13.281546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-5ed24752-c69a-4f08-bffc-a539758da9f0 req-5a7b1b7c-17f9-4a9f-90d0-86cc4ff4dc17 service nova] Creating event network-vif-deleted:24845303-1965-4326-8afa-08b6f4d5b13f for instance c456b05d-e74b-4b53-bac1-38abb22986cf on hv-cinder-74915 Jul 19 21:13:13.286900 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-5ed24752-c69a-4f08-bffc-a539758da9f0 req-5a7b1b7c-17f9-4a9f-90d0-86cc4ff4dc17 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208942 Jul 19 21:13:13.290572 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 587/1175] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:13:13.548501 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:13.549133 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:13.556482 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:13.556927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:13.557687 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:13.558111 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:13.594531 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:13.594979 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:13.595417 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.objects.instance [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lazy-loading 'fault' on Instance uuid c456b05d-e74b-4b53-bac1-38abb22986cf {{(pid=124278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:13:13.641500 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187add5855314ff5b802b74297a6e7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb315d23f40a4d1bbe9828c1d3a4e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:13:13.648877 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7dd33dc6-9691-4a3a-93d9-64f3f9739040 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 200 len: 1327 microversion: 2.1 time: 0.104200 Jul 19 21:13:13.649459 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 589/1176] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:13 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:13:14.668868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:14.669560 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:14.675826 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:14.676277 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:14.677070 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:14.677533 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:14.690608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] HTTP exception thrown: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Request method failure captured: Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf HTTP/1.1 Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xzNmuwzRWf3wpZOVcMH6WlY6FtSeIfVBjExaN9GIH18fniJNcqszAiW1mzJUGBUFps9uBgWJSNA7aAwaw-C0_14y9g7i1VF1hcDoGMS5r7i7ObVdXGzhaYt61bOCi3pFHNQuh-Tb6ON9N1h933GCyFb6Zb4bV-iONwKMbUi3CKHuPo Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:13:14.692252 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 187add5855314ff5b802b74297a6e7b0 Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:14.694106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'c456b05d-e74b-4b53-bac1-38abb22986cf'} Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:13:14.695205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:14.696898 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:14.698883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Returning 404 to user: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:13:14.698883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-788ef73b-4f43-4aa9-af56-256b309d7f88 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 404 len: 111 microversion: 2.1 time: 0.029591 Jul 19 21:13:14.698883 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 588/1177] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:14 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:13:14.702783 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a2c20d16-e8d3-4e9a-9fde-364a449a5146 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '.version_select at 0x7f1264037790>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:14.721204 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a2c20d16-e8d3-4e9a-9fde-364a449a5146 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-279943647" status: 202 len: 0 microversion: 2.1 time: 0.022164 Jul 19 21:13:14.721788 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 590/1178] 10.222.0.85 () {58 vars in 1217 bytes} [Tue Jul 19 21:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-279943647 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:13:17.617802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:17.618348 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:17.620677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:17.626038 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:17.626487 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:17.627255 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:17.627691 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:17.632513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:17.642800 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] HTTP exception thrown: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Request method failure captured: Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf HTTP/1.1 Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xzNmuwzRWf3wpZOVcMH6WlY6FtSeIfVBjExaN9GIH18fniJNcqszAiW1mzJUGBUFps9uBgWJSNA7aAwaw-C0_14y9g7i1VF1hcDoGMS5r7i7ObVdXGzhaYt61bOCi3pFHNQuh-Tb6ON9N1h933GCyFb6Zb4bV-iONwKMbUi3CKHuPo Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:13:17.644362 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 187add5855314ff5b802b74297a6e7b0 Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.646294 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': 'c456b05d-e74b-4b53-bac1-38abb22986cf'} Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:13:17.647272 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.649470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.651098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Returning 404 to user: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:13:17.651098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-90614104-bce2-42ea-8be9-f05a1ab90700 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 404 len: 111 microversion: 2.1 time: 0.031874 Jul 19 21:13:17.651098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 589/1179] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:13:17 2022] DELETE /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:13:17.657214 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:17.657820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: c456b05d-e74b-4b53-bac1-38abb22986cf] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:17.665010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:17.665462 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:17.666219 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:17.666656 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:17.679387 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] HTTP exception thrown: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Request method failure captured: Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf HTTP/1.1 Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xzNmuwzRWf3wpZOVcMH6WlY6FtSeIfVBjExaN9GIH18fniJNcqszAiW1mzJUGBUFps9uBgWJSNA7aAwaw-C0_14y9g7i1VF1hcDoGMS5r7i7ObVdXGzhaYt61bOCi3pFHNQuh-Tb6ON9N1h933GCyFb6Zb4bV-iONwKMbUi3CKHuPo Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:13:17.681015 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 187add5855314ff5b802b74297a6e7b0 Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.682658 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': 'c456b05d-e74b-4b53-bac1-38abb22986cf'} Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:13:17.683754 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. Jul 19 21:13:17.685350 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:17.686821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Returning 404 to user: Instance c456b05d-e74b-4b53-bac1-38abb22986cf could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:13:17.686821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d72433cb-4778-439f-9f86-fccfe290f5ec tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf" status: 404 len: 111 microversion: 2.1 time: 0.029892 Jul 19 21:13:17.686821 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 591/1180] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:17 2022] GET /compute/v2.1/servers/c456b05d-e74b-4b53-bac1-38abb22986cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:13:18.818092 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:18.818672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:18.826539 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:18.826993 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:18.827775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:18.828237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:18.842315 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] HTTP exception thrown: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Request method failure captured: Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 HTTP/1.1 Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1xzNmuwzRWf3wpZOVcMH6WlY6FtSeIfVBjExaN9GIH18fniJNcqszAiW1mzJUGBUFps9uBgWJSNA7aAwaw-C0_14y9g7i1VF1hcDoGMS5r7i7ObVdXGzhaYt61bOCi3pFHNQuh-Tb6ON9N1h933GCyFb6Zb4bV-iONwKMbUi3CKHuPo Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:13:18.843860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 187add5855314ff5b802b74297a6e7b0 Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.845397 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '73c20534-0f18-4ec7-b2c9-017e359ea7d5'} Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:13:18.846230 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.847859 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.849547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Returning 404 to user: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:13:18.849547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1e024bab-a0ed-453a-93eb-b80dc452c679 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jul 19 21:13:18.849547 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 590/1181] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:13:18 2022] DELETE /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:13:18.854483 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:13:18.855138 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] [instance: 73c20534-0f18-4ec7-b2c9-017e359ea7d5] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:13:18.857527 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:18.862998 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:18.863436 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:18.864191 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:13:18.864648 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:13:18.869256 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:13:18.882016 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.wsgi [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] HTTP exception thrown: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Request method failure captured: Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: request: GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 HTTP/1.1 Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept: application/json Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Accept-Encoding: identity Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Connection: close Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Length: 0 Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Content-Type: application/json Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Host: 10.222.0.85 Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Openstack-System-Scope: None Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: User-Agent: python-urllib3/1.26.9 Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Auth-Token: gAAAAABi1xzNmuwzRWf3wpZOVcMH6WlY6FtSeIfVBjExaN9GIH18fniJNcqszAiW1mzJUGBUFps9uBgWJSNA7aAwaw-C0_14y9g7i1VF1hcDoGMS5r7i7ObVdXGzhaYt61bOCi3pFHNQuh-Tb6ON9N1h933GCyFb6Zb4bV-iONwKMbUi3CKHuPo Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Id: None Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Domain-Name: None Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Identity-Status: Confirmed Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Is-Admin-Project: True Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Id: default Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Domain-Name: Default Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Project-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Role: member,reader Jul 19 21:13:18.883509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Roles: member,reader Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_cb315d23f40a4d1bbe9828c1d3a4e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Id: cb315d23f40a4d1bbe9828c1d3a4e5a7 Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-536148536 Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Id: default Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Domain-Name: Default Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Id: 187add5855314ff5b802b74297a6e7b0 Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: X-User-Name: tempest-AttachVolumeTestJSON-536148536-project Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: method: > Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: exception: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.885282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: action_args: {'id': '73c20534-0f18-4ec7-b2c9-017e359ea7d5'} Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:13:18.886284 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. Jul 19 21:13:18.887764 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR nova.api.openstack.wsgi Jul 19 21:13:18.889282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] Returning 404 to user: Instance 73c20534-0f18-4ec7-b2c9-017e359ea7d5 could not be found. {{(pid=124278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:13:18.889282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-f1cef1f1-bd28-4c2a-8497-b5c8159e8e62 tempest-AttachVolumeTestJSON-536148536 tempest-AttachVolumeTestJSON-536148536-project] 10.222.0.85 "GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5" status: 404 len: 111 microversion: 2.1 time: 0.034794 Jul 19 21:13:18.889282 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 592/1182] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:13:18 2022] GET /compute/v2.1/servers/73c20534-0f18-4ec7-b2c9-017e359ea7d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 21:14:31.920517 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:14:31.921183 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:15:00.720423 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:00.722135 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=3 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:00.908923 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-88ed6b23-4167-49a8-b350-18d8080ef8c7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Action: 'create', calling method: .version_select at 0x7f125f4feaf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-119011242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuJGO/QmZqrX+cV8p5oOQxZaOd63UkIgJTuKz9o9LM5lHoxwLMvWGHoObOK8FyxdzsCAEB2ltIa40W8yqsZahKUfjPC/Xv8uur0+NdR5RY3Wvpi8Xh3Tinfu+4TMjOfbw=="}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:00.927049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-88ed6b23-4167-49a8-b350-18d8080ef8c7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Getting quotas for project 8b9d58fb2dee4edf9632db6ee83312fb. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:15:00.932882 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.quota [None req-88ed6b23-4167-49a8-b350-18d8080ef8c7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Getting quotas for user 1c61ac31c3a24147ac629bd19f9cb9dc and project 8b9d58fb2dee4edf9632db6ee83312fb. Resources: {'key_pairs'} {{(pid=124277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:15:00.962291 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-88ed6b23-4167-49a8-b350-18d8080ef8c7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.248282 Jul 19 21:15:00.963309 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 591/1183] 10.222.0.85 () {60 vars in 1158 bytes} [Tue Jul 19 21:15:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:23.497010 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=1 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:23.501273 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-744668319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-119011242", "security_groups": [{"name": "tempest-secgroup-smoke-1190810369"}], "networks": [{"uuid": "90ffdafb-0dd7-432f-b721-2c983630039a"}], "block_device_mapping_v2": [{"uuid": "aaa62334-eb27-419c-b1ba-b3a4f8c43ef5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:23.743871 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.network.neutron [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] validate_networks() for [('90ffdafb-0dd7-432f-b721-2c983630039a', None, None, None, None, None)] {{(pid=124278) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 21:15:24.305479 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Flavor limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 21:15:24.306182 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Image limits 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 21:15:24.306758 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Flavor pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 21:15:24.307484 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Image pref 0:0:0 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 21:15:24.308216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.virt.hardware [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 21:15:24.321415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:24.321866 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:24.322681 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:24.323124 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:24.345727 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Getting quotas for project 8b9d58fb2dee4edf9632db6ee83312fb. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 21:15:24.350430 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.quota [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Getting quotas for user 1c61ac31c3a24147ac629bd19f9cb9dc and project 8b9d58fb2dee4edf9632db6ee83312fb. Resources: {'ram', 'instances', 'cores'} {{(pid=124278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 21:15:24.416053 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Going to run 1 instances... {{(pid=124278) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 21:15:24.419387 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aaa62334-eb27-419c-b1ba-b3a4f8c43ef5',volume_size=None,volume_type=None)] {{(pid=124278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 21:15:24.583295 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-b83313d5-c651-49f7-959a-ce3abade0b23 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.088302 Jul 19 21:15:24.584009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 593/1184] 10.222.0.85 () {60 vars in 1146 bytes} [Tue Jul 19 21:15:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 21:15:24.596007 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-00bd4f0b-99c9-429a-b5c8-bffc9854309f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:24.596747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-00bd4f0b-99c9-429a-b5c8-bffc9854309f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:24.601181 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:24.602590 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:24.785721 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-00bd4f0b-99c9-429a-b5c8-bffc9854309f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:24.795893 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-00bd4f0b-99c9-429a-b5c8-bffc9854309f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1087 microversion: 2.1 time: 0.204484 Jul 19 21:15:24.797412 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 592/1185] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:24 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1087 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:25.817279 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c8a1cbdd-4b7b-44a3-9586-ba9059b48d15 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:25.817992 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c8a1cbdd-4b7b-44a3-9586-ba9059b48d15 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:25.876587 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c8a1cbdd-4b7b-44a3-9586-ba9059b48d15 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:25.883696 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c8a1cbdd-4b7b-44a3-9586-ba9059b48d15 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1087 microversion: 2.1 time: 0.070868 Jul 19 21:15:25.884283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 594/1186] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:25 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:26.901932 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-9d16048b-e6ab-47c6-904b-76ef480f3f7a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:26.902686 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-9d16048b-e6ab-47c6-904b-76ef480f3f7a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:26.958350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-9d16048b-e6ab-47c6-904b-76ef480f3f7a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:26.965870 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-9d16048b-e6ab-47c6-904b-76ef480f3f7a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1087 microversion: 2.1 time: 0.067974 Jul 19 21:15:26.966441 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 593/1187] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:26 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:27.991389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:27.992287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:27.999554 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:28.000083 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:28.000884 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:28.001320 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:28.080746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:28.088657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-7ad81a7a-582e-4018-9438-a6206a98e164 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1203 microversion: 2.1 time: 0.102226 Jul 19 21:15:28.089490 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 595/1188] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:27 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1203 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:29.107608 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:29.108509 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:29.115647 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:29.116095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:29.116915 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:29.117349 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:29.281933 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:29.293459 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-d66bc097-800c-4a14-8e27-e75159a26990 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.190924 Jul 19 21:15:29.294052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 594/1189] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:29 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:29.520669 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-9e9d9810-d72f-4798-81c3-0cdc9432fe27 req-544de426-8428-44c5-9452-390a007e8638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:29.530933 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-9e9d9810-d72f-4798-81c3-0cdc9432fe27 req-544de426-8428-44c5-9452-390a007e8638 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:29.531607 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-9e9d9810-d72f-4798-81c3-0cdc9432fe27 req-544de426-8428-44c5-9452-390a007e8638 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:29.545074 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-9e9d9810-d72f-4798-81c3-0cdc9432fe27 req-544de426-8428-44c5-9452-390a007e8638 service nova] Creating event network-changed:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:15:29.551747 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-9e9d9810-d72f-4798-81c3-0cdc9432fe27 req-544de426-8428-44c5-9452-390a007e8638 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037261 Jul 19 21:15:29.552461 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 596/1190] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:30.314238 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:30.314860 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:30.321625 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:30.322073 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:30.322845 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:30.323281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:30.474413 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:30.483227 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-630eb81a-3e94-430b-ab82-8ca9e4630288 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.175010 Jul 19 21:15:30.483874 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 595/1191] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:30 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:31.504063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:31.504830 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:31.513147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:31.513147 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:31.513684 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:31.514121 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:31.685068 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:31.694493 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-607d5b43-fcd0-4828-a7cb-79b046f20d81 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.196190 Jul 19 21:15:31.695071 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 597/1192] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:31 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:32.713339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:32.714179 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:32.722104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:32.722546 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:32.723395 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:32.723885 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:32.879447 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:32.888052 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-099ecee2-6fa6-4908-a50c-80aaad79dff7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.178860 Jul 19 21:15:32.888720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 596/1193] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:32 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:33.906056 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:33.906647 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:33.913239 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:33.913677 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:33.914432 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:33.914853 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:34.064356 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:34.076429 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9e49fb45-283a-4549-9426-e8e2880e38b2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.174725 Jul 19 21:15:34.077163 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 598/1194] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:33 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:35.095376 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:35.096023 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:35.102811 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:35.103266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:35.104180 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:35.104776 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:35.258990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:35.267998 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-f64d17d5-3c14-49ff-b4fa-38915efa3319 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.176629 Jul 19 21:15:35.268617 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 597/1195] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:35 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:36.286906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:36.287669 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:36.289593 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=2 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:36.290762 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell0:SELECT=8 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:36.297637 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:36.298086 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:36.298891 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:36.299329 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:36.489895 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:36.504061 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8be44bc4-5536-4894-84e4-5d682b1289cc tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.221205 Jul 19 21:15:36.504927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 599/1196] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:36 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:37.527927 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:37.528699 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:37.531095 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell0:SELECT=4 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:15:37.536799 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.537253 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.538049 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:37.538490 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:37.719182 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:37.727658 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-277cc5ab-0ba3-4291-93bc-d06064b38bb8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.205280 Jul 19 21:15:37.728295 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 598/1197] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:37 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:38.746384 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:38.747235 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:38.754779 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:38.755219 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:38.756004 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:38.756479 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:38.915951 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:38.926415 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-a170f90b-1307-4a0e-82fe-36490c798628 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.184640 Jul 19 21:15:38.927013 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 600/1198] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:38 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:39.945119 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:39.945736 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:39.953790 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:39.954246 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:39.955041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:39.955513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:40.122414 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:40.131386 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-92b3dc73-5cf2-47d4-bd74-5e191b12da20 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.190192 Jul 19 21:15:40.131975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 599/1199] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:39 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:15:41.149216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:41.149805 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:41.156529 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:41.156975 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:41.157746 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:41.158173 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:41.315976 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:41.324974 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-13b248da-7748-4439-ab0c-393aad45e98a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.179237 Jul 19 21:15:41.325745 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 601/1200] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:41 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:41.507963 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-47f6f676-5a75-49dd-b654-990b43b0cd5e req-8a210e85-32ae-48de-9236-9c7fdee53456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "name": "network-vif-plugged", "status": "completed", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:41.516589 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-47f6f676-5a75-49dd-b654-990b43b0cd5e req-8a210e85-32ae-48de-9236-9c7fdee53456 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:41.517088 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-47f6f676-5a75-49dd-b654-990b43b0cd5e req-8a210e85-32ae-48de-9236-9c7fdee53456 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:41.533947 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-47f6f676-5a75-49dd-b654-990b43b0cd5e req-8a210e85-32ae-48de-9236-9c7fdee53456 service nova] Creating event network-vif-plugged:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:15:41.539081 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-47f6f676-5a75-49dd-b654-990b43b0cd5e req-8a210e85-32ae-48de-9236-9c7fdee53456 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093853 Jul 19 21:15:41.539664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 600/1201] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:15:42.342867 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:42.343565 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:42.350176 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:42.350620 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:42.351391 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:42.351822 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:42.493215 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:42.501434 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-64e01180-e651-47a3-867f-26eed52c37d4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.162549 Jul 19 21:15:42.502006 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 602/1202] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:42 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:43.519413 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:43.520099 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:43.526444 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:43.527511 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:43.528265 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:43.528720 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:43.664944 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:43.674174 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4e266430-55d6-4d2f-a680-1ebb30e37f8f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1259 microversion: 2.1 time: 0.159381 Jul 19 21:15:43.674771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 601/1203] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:43 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:44.691685 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:44.692286 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:44.700151 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:44.700627 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:44.701389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:44.701820 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:44.840757 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:44.848626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-5399a978-2ddd-444e-b58f-7eca549a057b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1443 microversion: 2.1 time: 0.160904 Jul 19 21:15:44.849190 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 603/1204] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:44 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:44.864569 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:15:44.865246 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:15:44.872218 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:44.872704 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:44.873515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:44.873952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:45.009296 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:15:45.017664 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-30276f96-f907-406d-8fdc-b346c89074ba tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1443 microversion: 2.1 time: 0.156895 Jul 19 21:15:45.018243 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 602/1205] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:15:44 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:15:47.032099 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-62440576-e6e5-4690-b6ae-0f7bb411a352 req-223c8daa-fcfa-4230-b601-38d43dc402e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:15:47.040807 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-62440576-e6e5-4690-b6ae-0f7bb411a352 req-223c8daa-fcfa-4230-b601-38d43dc402e8 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:15:47.041377 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-62440576-e6e5-4690-b6ae-0f7bb411a352 req-223c8daa-fcfa-4230-b601-38d43dc402e8 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:15:47.054196 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-62440576-e6e5-4690-b6ae-0f7bb411a352 req-223c8daa-fcfa-4230-b601-38d43dc402e8 service nova] Creating event network-changed:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:15:47.060280 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-62440576-e6e5-4690-b6ae-0f7bb411a352 req-223c8daa-fcfa-4230-b601-38d43dc402e8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105597 Jul 19 21:15:47.060912 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 604/1206] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:16:18.541378 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:16:18.542172 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:16:26.007012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:16:26.007688 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:17:51.930339 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:17:51.931092 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:17:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:18:01.864385 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR oslo.messaging._drivers.impl_rabbit [-] [902a3d58-fd1b-4ff9-b740-139ad0771195] AMQP server on 10.222.0.85:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 21:18:01.865102 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=26 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:01.865696 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=50 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:01.870163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:01.870738 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:01.878205 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:01.878666 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:01.879452 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:01.879890 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:01.905361 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.objects.instance [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lazy-loading 'flavor' on Instance uuid 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa {{(pid=124277) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 21:18:01.979433 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ff66bfdf-8170-4193-85b0-58d154d1d238 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "POST /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa/action" status: 202 len: 0 microversion: 2.1 time: 0.116878 Jul 19 21:18:01.980000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 603/1207] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:01 2022] POST /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:18:01.987160 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR oslo.messaging._drivers.impl_rabbit [-] [18aae83d-9d00-4547-ad84-0d806d9ec810] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:18:01.987832 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:01.988651 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=55 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:01.993613 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:01.994442 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:02.004313 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:02.004872 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:02.005667 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:02.006098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:02.145875 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:02.153671 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-dab91ded-098a-45a9-8ed7-a3a13f59f840 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.169034 Jul 19 21:18:02.154220 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 605/1208] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:01 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:03.173029 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:03.173746 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:03.180437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:03.180881 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:03.181637 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:03.182062 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:03.188396 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] [902a3d58-fd1b-4ff9-b740-139ad0771195] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 34452. Jul 19 21:18:03.318489 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:03.327527 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-6bec576e-b90f-4607-a79f-3def9674e8d5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.160219 Jul 19 21:18:03.328096 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 604/1209] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:03 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:04.345226 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:04.345818 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:04.358184 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] [18aae83d-9d00-4547-ad84-0d806d9ec810] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 34456. Jul 19 21:18:04.360263 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:04.360723 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:04.361487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:04.361906 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:04.502181 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:04.509772 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9d3d8850-0b5b-4b5d-8ab0-52da86924c25 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.169226 Jul 19 21:18:04.510336 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 606/1210] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:04 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:05.526952 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:05.527523 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:05.534652 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:05.535094 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:05.535853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:05.536284 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:05.674115 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:05.681731 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-94f89748-4b58-4299-a5f4-e02e53339064 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.158870 Jul 19 21:18:05.682289 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 605/1211] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:05 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:06.702736 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:06.704362 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:06.710045 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:06.710487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:06.711259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:06.711692 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:06.798791 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:18:06.800915 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:18:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa (ip 10.222.0.85) !!! Jul 19 21:18:06.854367 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:06.862965 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-638c5d2a-1488-4048-b7bc-9b0039274be4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.164590 Jul 19 21:18:06.863543 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 607/1212] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:06 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:07.880775 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:07.881403 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:07.888071 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:07.888563 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:07.889335 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:07.890359 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:08.024163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:08.031695 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-bce8d1d9-78d4-4047-90f0-9547cb4a6a16 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.154747 Jul 19 21:18:08.032388 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 606/1213] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:07 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:09.051219 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:09.051829 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:09.058177 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:09.058629 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:09.059395 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:09.059833 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:09.199116 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:09.207439 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-14800cdf-1157-41fb-a064-6ab073ad3333 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.160446 Jul 19 21:18:09.208009 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 608/1214] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:09 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:10.225079 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:10.225709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:10.232244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:10.232721 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:10.234089 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:10.234525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:10.369237 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:10.377041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0fa9c6a1-869b-45ac-8f7e-0da222efe97f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.155735 Jul 19 21:18:10.377622 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 607/1215] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:10 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:11.394299 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:11.394956 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:11.401359 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:11.401812 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:11.402567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:11.403000 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:11.563917 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:11.572256 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-3ee01a45-5f69-4354-ade9-30559228f1e0 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.181823 Jul 19 21:18:11.572850 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 609/1216] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:11 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:12.589281 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:12.589922 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:12.598018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:12.598465 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:12.599241 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:12.599672 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:12.746453 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:12.759513 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-c8a5c00a-63d9-4e9f-b67d-b3f5f7cba729 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.173478 Jul 19 21:18:12.764913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 608/1217] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:12 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:13.777454 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:13.778052 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:13.785107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:13.785550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:13.786304 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:13.786762 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:13.924799 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:13.932339 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-12e628bb-007e-4f5f-a6b6-8ee1d7466889 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.158856 Jul 19 21:18:13.932934 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 610/1218] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:13 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:14.951661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:14.953018 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:14.959772 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:14.960215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:14.961012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:14.961445 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:15.108832 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:15.116700 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-4a96e9e6-0b20-4f9a-9abf-fd1876d50286 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.170250 Jul 19 21:18:15.117266 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 609/1219] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:14 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:16.138976 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:16.139657 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:16.146157 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:16.146680 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:16.147352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:16.147776 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:16.282070 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:16.289972 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6ae39170-daac-4ce7-a74d-b577d988446a tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1508 microversion: 2.1 time: 0.154804 Jul 19 21:18:16.290537 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 611/1220] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:16 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:16.307091 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:16.307661 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:16.314475 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:16.314914 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:16.315674 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:16.316104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:16.455884 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-ed49007a-7aac-44cd-8190-ccaf525522f2 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "POST /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa/action" status: 202 len: 0 microversion: 2.1 time: 0.152651 Jul 19 21:18:16.459676 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 610/1221] 10.222.0.85 () {60 vars in 1277 bytes} [Tue Jul 19 21:18:16 2022] POST /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:18:16.464927 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:16.465532 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:16.472497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:16.472947 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:16.473774 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:16.474208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:16.660641 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:16.669385 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-49fe8dc1-e55e-4df5-92ba-bb4497eca02f tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1516 microversion: 2.1 time: 0.208323 Jul 19 21:18:16.670055 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 612/1222] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:16 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:17.686402 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:17.686994 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:17.693278 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:17.693733 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:17.694503 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:17.694940 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:17.849514 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:17.858677 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0792d2f1-d449-49c6-af18-9796b4910096 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1518 microversion: 2.1 time: 0.176416 Jul 19 21:18:17.859525 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 611/1223] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:17 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:18.223857 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "name": "network-vif-unplugged", "status": "completed", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:18.236713 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:18.237468 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:18.253005 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] Creating event network-vif-unplugged:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:18:18.257368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: ERROR oslo.messaging._drivers.impl_rabbit [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] [4a6c65f5-06a2-4040-b335-652cb6c2e0a1] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 21:18:18.878463 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:18.879310 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:18.886757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:18.887196 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:18.887953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:18.888415 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:19.026651 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:19.034179 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cc2accd4-1ec8-4af7-a478-e40d9c0cf6e7 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.161061 Jul 19 21:18:19.034739 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 612/1224] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:18 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:19.265107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] [4a6c65f5-06a2-4040-b335-652cb6c2e0a1] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 34512. Jul 19 21:18:19.268226 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-38b85a93-c6a2-4b82-8c0e-0692c646de25 req-5629f04a-3358-4630-bbee-707ba55044bb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.050734 Jul 19 21:18:19.268910 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 613/1225] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:18:20.050785 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:20.051400 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:20.058707 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:20.059147 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:20.059935 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:20.060391 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:20.193221 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:20.201592 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0bb3fc76-496a-41e8-9af6-eb4667361515 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.154835 Jul 19 21:18:20.202163 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 613/1226] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:20 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:21.219990 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:21.220828 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:21.227716 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:21.228163 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:21.228962 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:21.229389 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:21.367268 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:21.374992 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-9d7008bf-04f2-4cd5-9387-92e9a36627ef tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.159759 Jul 19 21:18:21.375545 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 614/1227] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:21 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:22.393462 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:22.394104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:22.401387 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:22.401834 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:22.402605 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:22.403041 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:22.542377 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:22.551011 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-44b07f12-d647-46bc-b968-1da8c72648f5 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.161514 Jul 19 21:18:22.551582 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 614/1228] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:22 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:23.568813 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:23.569371 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:23.576089 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:23.576567 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:23.577330 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:23.577759 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:23.714166 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:23.722063 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c7d4035a-a1b6-4a78-862b-bf3ab60d4796 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.157444 Jul 19 21:18:23.722672 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 615/1229] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:23 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:24.741561 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:24.742268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:24.749196 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:24.749648 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:24.750425 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:24.750868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:24.892520 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:24.900437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-cd3f3339-d9e3-4bc4-851e-06ba2cf65955 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.163217 Jul 19 21:18:24.901000 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 615/1230] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:24 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:25.917514 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:25.918144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:25.924704 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:25.925149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:25.925912 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:25.926342 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:26.059731 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:26.067167 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-c43a70bb-f7dc-49f3-abf3-00ae1a2111f8 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.153532 Jul 19 21:18:26.067936 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 616/1231] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:25 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:27.086457 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:27.087072 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:27.093569 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:27.093950 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:27.094708 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:27.095137 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:27.113552 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:27.239171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:27.246930 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-2182feb4-ef9d-49de-b7c5-93c83705ea9d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.164924 Jul 19 21:18:27.247868 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 616/1232] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:27 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:28.264600 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:28.265216 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:28.273011 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:28.273626 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:28.274550 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:28.275098 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:28.418811 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:28.426709 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-d74f484c-7a13-42f3-a68a-76241008c1b4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.165971 Jul 19 21:18:28.427278 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 617/1233] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:28 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:18:29.443106 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:29.443723 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:29.450337 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:29.451036 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:29.451808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:29.452244 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:29.585268 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:29.592975 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-268f2743-ca85-4442-bfa4-426baf4e7e0b tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.153760 Jul 19 21:18:29.593538 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 617/1234] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:29 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:30.316497 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [req-5cb1ef6c-2505-47e9-9c1b-e647e466fdbf req-d5b95764-2f79-4e81-9bc5-1d336862caf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "name": "network-vif-plugged", "status": "completed", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:18:30.326602 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5cb1ef6c-2505-47e9-9c1b-e647e466fdbf req-d5b95764-2f79-4e81-9bc5-1d336862caf7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:30.326939 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [req-5cb1ef6c-2505-47e9-9c1b-e647e466fdbf req-d5b95764-2f79-4e81-9bc5-1d336862caf7 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:30.339274 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.compute.server_external_events [req-5cb1ef6c-2505-47e9-9c1b-e647e466fdbf req-d5b95764-2f79-4e81-9bc5-1d336862caf7 service nova] Creating event network-vif-plugged:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:18:30.344352 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [req-5cb1ef6c-2505-47e9-9c1b-e647e466fdbf req-d5b95764-2f79-4e81-9bc5-1d336862caf7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031557 Jul 19 21:18:30.345144 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 618/1235] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:18:30.610660 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:30.611262 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:30.618953 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:30.619392 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:30.620172 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:30.620635 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:30.767808 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:30.776012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-0022628b-12e7-4d8f-81de-fac679b69170 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.169129 Jul 19 21:18:30.776624 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 618/1236] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:30 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:31.793583 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:31.794368 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:31.800660 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:31.801088 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:31.801836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:31.802259 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:31.936218 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:31.944363 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-fa1d1c1d-5695-43e0-b22f-3c37f965e040 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1574 microversion: 2.1 time: 0.154906 Jul 19 21:18:31.945085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 619/1237] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:31 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:18:32.962718 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:18:32.963451 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:18:32.966470 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=35 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:18:32.973365 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:32.973990 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:32.975110 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:18:32.975476 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:18:33.131853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:18:33.143215 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-3fbea19c-79bb-4cdf-ab5c-9dcc61452362 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1561 microversion: 2.1 time: 0.184726 Jul 19 21:18:33.144168 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 619/1238] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:18:32 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:19:38.551037 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:19:38.551967 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:20:04.791437 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:20:04.792171 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:20:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:20:09.100246 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_api:SELECT=30 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:20:09.101046 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG dbcounter [-] [124278] Writing DB stats nova_cell1:SELECT=82 {{(pid=124278) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:20:09.101941 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_api:SELECT=1 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:20:09.102891 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG dbcounter [-] [124277] Writing DB stats nova_cell1:SELECT=20 {{(pid=124277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:20:09.108124 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-700c5db2-b5cb-4edc-b2be-ac93481aff60 req-9cc9208a-0c6b-464f-acf2-7386f4e6b454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:20:09.108405 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:20:09.109003 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:20:09.116937 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:09.117379 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:09.117747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-700c5db2-b5cb-4edc-b2be-ac93481aff60 req-9cc9208a-0c6b-464f-acf2-7386f4e6b454 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:09.118149 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:09.118322 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-700c5db2-b5cb-4edc-b2be-ac93481aff60 req-9cc9208a-0c6b-464f-acf2-7386f4e6b454 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:09.118734 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:09.131853 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-700c5db2-b5cb-4edc-b2be-ac93481aff60 req-9cc9208a-0c6b-464f-acf2-7386f4e6b454 service nova] Creating event network-changed:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:20:09.139080 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-700c5db2-b5cb-4edc-b2be-ac93481aff60 req-9cc9208a-0c6b-464f-acf2-7386f4e6b454 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038781 Jul 19 21:20:09.139716 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 620/1239] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:20:09.146888 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Going to try to terminate instance {{(pid=124278) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 21:20:09.255107 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-6a1f6db8-2c68-4a41-af38-8170c912c058 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 204 len: 0 microversion: 2.1 time: 0.156877 Jul 19 21:20:09.256208 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 620/1240] 10.222.0.85 () {58 vars in 1238 bytes} [Tue Jul 19 21:20:09 2022] DELETE /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 21:20:09.265458 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:20:09.266336 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:20:09.273507 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:09.274104 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:09.275151 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:09.275914 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:09.434892 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.policy [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124277) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:20:09.442938 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-14b3d20f-be03-48ef-9a5d-92a591b1f8e4 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.181893 Jul 19 21:20:09.443781 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 621/1241] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:20:09 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 21:20:10.461037 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:20:10.461739 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:20:10.468686 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:10.469494 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:10.469916 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:10.470464 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:10.620611 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:20:10.629515 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-407cb589-0d0b-45a3-ab65-5d77945d942e tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1567 microversion: 2.1 time: 0.172640 Jul 19 21:20:10.630085 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 621/1242] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:20:10 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:20:11.610709 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [req-e069e153-4f07-42e9-93a9-4dd2e066ae0c req-198e0b7a-eff6-440c-9227-c589bfd2f856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4d060b-10af-4eaa-bcbe-8f5b546b50fa", "name": "network-vif-deleted", "tag": "c66489d9-cc09-4f41-a022-838ea79fd98e"}]} {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 21:20:11.618913 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e069e153-4f07-42e9-93a9-4dd2e066ae0c req-198e0b7a-eff6-440c-9227-c589bfd2f856 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:11.619350 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [req-e069e153-4f07-42e9-93a9-4dd2e066ae0c req-198e0b7a-eff6-440c-9227-c589bfd2f856 service nova] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:11.631747 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.compute.server_external_events [req-e069e153-4f07-42e9-93a9-4dd2e066ae0c req-198e0b7a-eff6-440c-9227-c589bfd2f856 service nova] Creating event network-vif-deleted:c66489d9-cc09-4f41-a022-838ea79fd98e for instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa on hv-cinder-74915 Jul 19 21:20:11.636798 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [req-e069e153-4f07-42e9-93a9-4dd2e066ae0c req-198e0b7a-eff6-440c-9227-c589bfd2f856 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105671 Jul 19 21:20:11.637389 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 622/1243] 10.222.0.85 () {64 vars in 1317 bytes} [Tue Jul 19 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 21:20:11.647425 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:20:11.648171 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.compute.api [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124278) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:20:11.654836 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:11.655283 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:11.656041 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:11.656502 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG oslo_concurrency.lockutils [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124278) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:11.721563 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.policy [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c61ac31c3a24147ac629bd19f9cb9dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b9d58fb2dee4edf9632db6ee83312fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124278) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 21:20:11.731403 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-4b4aadf3-d637-4e7b-9d54-d6ad0772886d tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 200 len: 1218 microversion: 2.1 time: 0.088241 Jul 19 21:20:11.731919 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 622/1244] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:20:11 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 21:20:12.749757 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '>' {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:20:12.750631 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.compute.api [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] [instance: 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa] Fetching instance by UUID {{(pid=124277) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 21:20:12.757282 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:12.757729 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:12.758509 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 21:20:12.758945 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG oslo_concurrency.lockutils [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Lock "59211ec6-fafb-454c-996a-b8f138acc18b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 21:20:12.776097 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.wsgi [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] HTTP exception thrown: Instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa could not be found. Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Request method failure captured: Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: request: GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa HTTP/1.1 Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept: application/json Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Accept-Encoding: identity Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Connection: close Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Length: 0 Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Content-Type: application/json Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Host: 10.222.0.85 Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Openstack-System-Scope: None Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: User-Agent: python-urllib3/1.26.9 Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Auth-Token: gAAAAABi1x7Pa4qrKR05TDA_OPl_KFYkDfPw18rXL0JyKVDKfBnMfgtNGEuHWd_wPSYWqhMm94WZVnK_tFQEVZglYhlNtgvqdag4_Ldl9d6QRESCnSEXYnC6Zp22Ihh7rLsdl3tvQhzRgh_sJqFupLOFw3OvKZTQlUoUUjXXdM9ukm35PvvzYmI Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Id: None Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Domain-Name: None Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Identity-Status: Confirmed Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Is-Admin-Project: True Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Id: default Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Domain-Name: Default Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Id: 8b9d58fb2dee4edf9632db6ee83312fb Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Project-Name: tempest-TestShelveInstance-2015387047 Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Role: member,reader Jul 19 21:20:12.777813 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Roles: member,reader Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b9d58fb2dee4edf9632db6ee83312fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8b9d58fb2dee4edf9632db6ee83312fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8b9d58fb2dee4edf9632db6ee83312fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8b9d58fb2dee4edf9632db6ee83312fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant: tempest-TestShelveInstance-2015387047 Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Id: 8b9d58fb2dee4edf9632db6ee83312fb Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-Tenant-Name: tempest-TestShelveInstance-2015387047 Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User: tempest-TestShelveInstance-2015387047-project Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Id: default Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Domain-Name: Default Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Id: 1c61ac31c3a24147ac629bd19f9cb9dc Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: X-User-Name: tempest-TestShelveInstance-2015387047-project Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: method: > Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: exception: Instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa could not be found. Jul 19 21:20:12.780515 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: action_args: {'id': '2d4d060b-10af-4eaa-bcbe-8f5b546b50fa'} Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: {{(pid=124277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa could not be found. Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 21:20:12.781771 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa could not be found. Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa could not be found. Jul 19 21:20:12.783744 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: ERROR nova.api.openstack.wsgi Jul 19 21:20:12.785802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: DEBUG nova.api.openstack.wsgi [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Returning 404 to user: Instance 2d4d060b-10af-4eaa-bcbe-8f5b546b50fa could not be found. {{(pid=124277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 21:20:12.785802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO nova.api.openstack.requestlog [None req-1da72346-c691-4f9b-ad03-b5248cadb080 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa" status: 404 len: 111 microversion: 2.1 time: 0.034986 Jul 19 21:20:12.785802 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: [pid: 124277|app: 0|req: 623/1245] 10.222.0.85 () {58 vars in 1235 bytes} [Tue Jul 19 21:20:12 2022] GET /compute/v2.1/servers/2d4d060b-10af-4eaa-bcbe-8f5b546b50fa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 21:20:12.970509 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: DEBUG nova.api.openstack.wsgi [None req-8de4a6cd-e2b4-4b4c-8f5b-9c2fbc4a5c14 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] Calling method '.version_select at 0x7f125f6ad1f0>' {{(pid=124278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 21:20:13.001307 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO nova.api.openstack.requestlog [None req-8de4a6cd-e2b4-4b4c-8f5b-9c2fbc4a5c14 tempest-TestShelveInstance-2015387047 tempest-TestShelveInstance-2015387047-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-119011242" status: 202 len: 0 microversion: 2.1 time: 0.035250 Jul 19 21:20:13.001902 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: [pid: 124278|app: 0|req: 623/1246] 10.222.0.85 () {58 vars in 1250 bytes} [Tue Jul 19 21:20:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-119011242 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 21:21:11.939185 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:21:11.939838 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:21:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:21:26.018120 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:21:26.018819 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:21:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:21:26.810381 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:21:26.810963 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:21:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:22:58.560692 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:22:58.561522 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:23:24.800344 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:23:24.800997 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:23:26.394674 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:23:26.395287 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:23:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:24:31.947012 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:24:31.947685 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:24:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:24:46.026098 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:24:46.026878 dv-cinder-749155-8-iscsi devstack@n-api.service[124277]: Tue Jul 19 21:24:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 21:24:46.818487 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 21:24:46.819076 dv-cinder-749155-8-iscsi devstack@n-api.service[124278]: Tue Jul 19 21:24:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!